Senior Data Engineer
Atlanta, Georgia
Employer: INTELLISWIFT INC
Industry: Customer Job
Salary: Competitive
Job type: Full-Time
Job ID: 24-03315 Onsite Senior Data Engineer is responsible for managing and organizing enterprise data . They will translate requirements and designs into functional data pipelines while ensuring the continued quality and completeness of information.
Senior Data Engineers will combine raw information from different sources to create consistent and machine-readable datasets that are easy to analyze and support company initiatives. They will support other Data Engineers and Data Analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
They will also implement methods to improve data reliability and quality , improve data visibility and reduce effort through automation.
Essential Duties
Requirements
Senior Data Engineers will combine raw information from different sources to create consistent and machine-readable datasets that are easy to analyze and support company initiatives. They will support other Data Engineers and Data Analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
They will also implement methods to improve data reliability and quality , improve data visibility and reduce effort through automation.
Essential Duties
- Contribute on a team of data engineers through design , demand delivery, code reviews , release management , implementation , presentations , and meetings.
- Mentor fellow data engineers and contribute to ongoing process improvements for the team
- Evaluate business needs and objectives and align architecture designs with business requirements
- Build the data pipelines required for the optimal extraction, transformation, integration and loading of raw data from a wide variety of data sources
- Assemble large, complex data sets and model our data in a way that meets functional non-functional business requirements
- Create data tools for analytics team members that assist them in generating innovative industry insights that provide our business a competitive advantage
- Implement data tagging mechanisms and metadata management so data is accurately classified and visible to the organization
- Build processes to help identify and improve data quality, consistency and effectiveness
- Ensure our data is managed in a way that it conforms to all information privacy and protection policies
- Use agile software development processes to iteratively make improvements to our data management systems Identify opportunities for automation
- Be an advocate for best practices and continued learning
Requirements
- Bachelor's Tech School degree in Computer Science, Information Systems, Engineering or equivalent and or commensurate years of real-world experience in software engineering.
- 4+ years of relevant experience in data management
- 3+ years in data engineering with detailed knowledge of data warehouse technical architectures , infrastructure components , ETL ELT .
- Must have Snowflake
- Experience with performance analysis and optimization .
- Experience in data acquisition , transformation and storage design using design principles, patterns and best practices.
- Data engineering certification is a plus .
- Experience with Informatica , Kafka , CDC, SQL, Irwin, Python , AWS (S3, Athena, Glue, Kinesis, Redshift), Spark , Scala, AI Client , Modern data platforms, Snowflake , dbt , Fivetran and Airflow
Created: 2024-06-09
Reference: MwLXqLy9hTbd
Country: United States
State: Georgia
City: Atlanta
ZIP: 30334
Similar jobs:
-
Sr. Data Engineer - Remote
UnitedHealth Group in Atlanta, Georgia💸 $85000 - $167300. per year -
Sr. Data Engineer
NLB Services in Atlanta, Georgia -
Sr. Data Engineer
TK Elevator in Atlanta, Georgia -
Senior Engineer - Commercial Data Engineering
American Express in Atlanta, Georgia💸 $110000.00 per year -
Sr. Data Engineer\/Data Architect
Compunnel in Atlanta, Georgia -
Manager, Data Engineer, Global Health & Wellbeing
Delta Air Lines in Atlanta, Georgia -
Cloudera Data Engineer
GAP Solutions, Inc. in Atlanta, Georgia -
Sr. Data Engineer
TK Elevator in Atlanta, Georgia -
Practice Fusion Data Engineer
Medix in United States of America, Georgia -
Senior Data Engineer
Koch Industries in Atlanta, Georgia💸 $100000 - $140000 per year -
Data Engineer (Remote)
Cisco Systems Inc in Atlanta, Georgia -
Project Engineer, Data Center , DCC Communities
Amazon in Atlanta, Georgia -
Manager, Data Engineer, Global Health and Wellbeing
Delta Air Lines in Atlanta, Georgia -
SiteOps Data Center Production Operations Engineer
Meta in Newton County, Georgia -
Senior Data Engineer
System One Holdings, LLC in Atlanta, Georgia -
Data Engineer
AEG in Atlanta, Georgia -
Sr. Manager Enterprise Data of Science & Engineering
Leaf Home in Atlanta, Georgia -
Data Engineer 2 (Mailchimp)
Intuit in Atlanta, Georgia -
Cloud Data Engineer
Apex Systems in Atlanta, Georgia -
Data Engineer
Koch Industries in Atlanta, Georgia