Data Engineer
Bellevue, Washington
Employer: Meta
Industry:
Salary: Competitive
Job type: Full-Time
At Meta, we have many opportunities to work with data each and every day. In this role as a Data Engineer on the Meta Data Center's Data Science team, your primary responsibility will be to partner with key stakeholders, data scientists and software engineers to support and enable the continued growth critical to Meta's Data Center organization. You will be responsible for creating the technology and data architecture that moves and translates data used to inform our most critical strategic and real-time decisions. You will also help translate business needs into requirements and identify efficiency opportunities. In addition to extracting and transforming data, you will be expected to use your expertise to build extensible data models, provide meaningful recommendations and actionable strategies to partnering data scientist for performance enhancements and development of best practices, including streamlining of data sources and related programmatic initiatives. The ideal candidate will have a passion for working in white space and creating impact from the ground up in a fast-paced environment. This position is part of the Infrastructure Data Center team.
Data Engineer Responsibilities
Minimum Qualifications
Preferred Qualifications
Start preparing
Learn about how to prepare for your interview with our interview guide, tips, and interactive experiences.
Visit interview prep
Data Engineer Responsibilities
- Partner with leadership, engineers, program managers and data scientists to understand data needs
- Apply proven expertise and build high-performance scalable data warehouses
- Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
- Securely source external data from numerous partners
- Intelligently design data models for optimal storage and retrieval
- Deploy inclusive data quality checks to ensure high quality of data
- Optimize existing pipelines and maintain of all domain-related data pipelines
- Ownership of the end-to-end data engineering component of the solution
- Support on-call shift as needed to support the team
- Design and develop new systems in partnership with software engineers to enable quick and easy consumption of data
Minimum Qualifications
- BS/MS in Computer Science or a related technical field
- 5+ years of Python or other modern programming language development experience
- 5+ years of SQL and relational databases experience
- 5+ years experience in custom ETL design, implementation and maintenance
- 3+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)
- 3+ years experience with Data Modeling
- Experience working with cloud or on-premises Big Data/MPP analytics platform (i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar)
- 2+ years experience working with enterprise DE tools and experience learning in-house DE tools
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
Preferred Qualifications
- Experience with more than one coding language
- Experience designing and implementing real-time pipelines
- Experience with data quality and validation
- Experience with SQL performance tuning and end-to-end process optimization
- Experience with anomaly/outlier detection
- Experience with notebook-based Data Science workflow
- Experience with Airflow
- Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.
- Experience building systems integrations, tooling interfaces, implementing integrations for ERP systems (Oracle, SAP, Saleforce etc).
Start preparing
Learn about how to prepare for your interview with our interview guide, tips, and interactive experiences.
Visit interview prep
Created: 2024-05-08
Reference: 417725504174666
Country: United States
State: Washington
City: Bellevue
ZIP: 98004
Similar jobs:
-
Software Development Engineer, Business Data Technologies
Amazon in Seattle, Washington💸 $115000 per year -
Data Engineer III, Organizational Planning and Effectiveness (OPE)
Amazon in Seattle, Washington💸 $123700 per year -
Senior Data Engineer, AWS Energy Team
Amazon in Seattle, Washington💸 $123700 per year -
Backend Software Engineer - Data-E-Commerce Risk Control
TikTok in Seattle, Washington -
Data Scientist, Middle Mile Transportation Network Engineering, Scheduling and Technology
Amazon in Bellevue, Washington💸 $111600 per year -
Data Engineer
Piper Companies in Washington, Washington💸 $135000 - $145000 per year -
Machine Learning Engineer - Data Curation - AIGC, TikTok Monetization GenAI
TikTok in Seattle, Washington -
Data Engineer, Amazon
Amazon in Seattle, Washington💸 $105700 per year -
Senior Software Data Engineer - App Store
Apple in Seattle, Washington -
DC Design Manager -PDCM, Data Center Engineering
Amazon in Seattle, Washington💸 $93500 per year -
Data Engineer II, Alexa Devices
Amazon in Bellevue, Washington💸 $105700 per year -
Sr. Manager: Business Intelligence and Data Engineering, Prime Video Product and Tech
Amazon in Seattle, Washington💸 $161900 per year -
Data Engineer, Analytics
Meta in Bellevue, Washington -
Sr. Construction Scheduler in Data Center Engineering - Civil, Structural, Architectural Solutions
Amazon in Seattle, Washington💸 $114300 per year -
Software Engineer - Data Privacy and Security
TikTok in Seattle, Washington -
Data Engineer
Piper Companies in Washington, Washington💸 $110000 - $150000 per year -
Data Engineer, E-Commerce
TikTok in Seattle, Washington -
Software Development Engineer, EC2 Capacity Data Intelligence and Platform Team (CDIP)
Amazon in Seattle, Washington💸 $115000 per year -
Software Development Engineer, Open Data Analytics Fundamentals
Amazon in Redmond, Washington💸 $115000 per year -
DC Design Manager for Region (AMER), Data Center Engineering
Amazon in Seattle, Washington💸 $114300 per year