Data Engineer, Senior
Arlington, Virginia
Employer: NuWave Solutions
Industry: Engineering
Salary: Competitive
Job type: Full-Time
Overview
BigBear.ai is seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
This role will be Hybrid/Remote reporting to the Crystal, City VA 2- 3 days per week and requires an active Secret clearance.
What you will do
What you need to have
What we'd like you to have
About BigBear.ai
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on BigBear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in Columbia, Maryland, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit https://bigbear.ai/ and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
What you will do
What you need to have
BigBear.ai is seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
This role will be Hybrid/Remote reporting to the Crystal, City VA 2- 3 days per week and requires an active Secret clearance.
What you will do
- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
- Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
- Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
- Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
- Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
- Maintain documentation for software applications, workflows, and processes.
- Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
What you need to have
- Secret clearance is required; TS/SCI clearance is preferred.
- Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
- High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Strong problem-solving skills and ability to solve complex data-related issues.
- Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
- Understanding of data modeling/visualization, database design principles, and data governance practices.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Detail-oriented mindset with a commitment to delivering high-quality results.
- DoD or IC-related experience
- Must be in the DC Metro area and available to work onsite (Crystal City, VA ) 2-3 days per week.
What we'd like you to have
- Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus.
- Previous experience with Advana is a plus.
About BigBear.ai
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on BigBear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in Columbia, Maryland, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit https://bigbear.ai/ and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
What you will do
- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
- Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
- Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
- Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
- Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
- Maintain documentation for software applications, workflows, and processes.
- Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
What you need to have
- Secret clearance is required; TS/SCI clearance is preferred.
- Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
- High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Strong problem-solving skills and ability to solve complex data-related issues.
- Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
- Understanding of data modeling/visualization, database design principles, and data governance practices.
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Detail-oriented mindset with a commitment to delivering high-quality results.
- DoD or IC-related experience
- Must be in the DC Metro area and available to work onsite (Crystal City, VA ) 2-3 days per week.
Created: 2024-09-14
Reference: 3904
Country: United States
State: Virginia
City: Arlington
ZIP: 22209
Similar jobs:
-
Senior Software Development Engineer, AWS Documentation Engineering, TCX Engineering
Amazon in Arlington, Virginia -
Senior Network Engineer
General Dynamics Corporation in Langley AFB, Virginia💸 $93500 - $126500. per year -
Senior Water Resources Engineer
HDR in Virginia Beach, Virginia -
Senior Systems Engineer
Leidos Holding in Alexandria, Virginia💸 $122200.00 per year -
Senior Software Development Engineer, Amazon Stores
Amazon in Arlington, Virginia💸 $134500 per year -
Senior Electrical Engineer - Aviation & Federal (Roanoke)
Burns & McDonnell in Roanoke, Virginia -
Senior Electrical Commissioning Engineer - Aviation & Federal (Multiple Locations)
Burns & McDonnell in Richmond, Virginia -
Senior Security Engineer, Research and Automation, AWS Security Operations, Security Operations
Amazon in Herndon, Virginia -
Senior Software Development Engineer, Amazon Stores
Amazon in Arlington, Virginia💸 $134500 per year -
Network Engineer Senior - TS/SCI Required
General Dynamics Corporation in Charlottesville, Virginia💸 $138859 - $187867. per year -
Senior Substation Site Civil Engineer
Leidos Holding in Remote, Virginia💸 $68900.00 per year -
Network Switching Design Engineer Senior
Leidos Holding in Quantico, Virginia💸 $87100.00 per year -
Senior Software Development Engineer, AWS, Network Capacity Services
Amazon in Herndon, Virginia -
Senior Specialist Software Engineer (Top Secret/SCI)
L-3 Technologies in Dahlgren, Virginia -
Senior Site Reliability Engineer - Remote - USA
FullStack Labs in Richmond, Virginia -
Senior HPC Systems Engineer
General Dynamics Corporation in Falls Church, Virginia💸 $83096 - $154211. per year -
Senior Software Development Engineer, EC2 Catalyst
Amazon in Herndon, Virginia💸 $151300 per year -
Senior Cyber Security Engineer (Cloud)
SAIC in Fort Belvoir, Virginia -
Senior Systems Engineer
Leidos Holding in Alexandria, Virginia💸 $122200.00 per year -
Senior Substation Civil Structural Engineer
Leidos Holding in Remote, Virginia💸 $68900.00 per year