Data Engineer I, GTS Field - Kadie Newman

Do you want to be in the forefront of engineering big data solutions that takes Transportation models to the next generation? Do you have a solid analytical thinking, metrics driven decision making and want to solve problems with solutions that will meet the growing worldwide need?

We are seeking an experienced Data Engineer to work in a large and complex data warehouse environment. You will bring together disparate datasets to answer business questions. You will collaborate with Business Intelligence Engineers, Data Scientists, and business teams across the organization.

In this role, you will own the end-to-end development of data engineering solutions, playing a critical role in strategic decision-making. You will work with relational database management systems, develop key business questions, onboard new datasets, and analyze data.

The ideal candidate is a self-starter, comfortable with ambiguity, and able to create and maintain automated processes efficiently. You should have strong analytical thinking, metrics-driven decision-making, and enjoy working with large volumes of data in complex technical contexts. Expertise in data modeling, ETL design, business intelligence tools, SQL, data warehousing, and building ETL pipelines is essential.

Key job responsibilities

- Ensure compliance with data governance and regulatory requirements, implementing data lineage tracking, auditing, and monitoring mechanisms.

- Collaborate with legal and compliance teams to adhere to applicable laws.

- Monitor and manage running queries on the cluster, optimize resource utilization, and develop solutions for Redshift cluster optimization.

- Evaluate data retention requirements, implement archiving and purging strategies, manage dataset migrations, and design solutions for backfilling new datasets.

- Identify and create curated datasets, ensuring data quality and documentation, and provide tools for stakeholders to utilize these datasets.

- Standardize data inputs for tools under development and provide Data Engineering support.

- Establish access controls and guardrails to prevent unauthorized or inefficient use of cluster resources.

- Generate complete, reusable metadata and dataset documentation.

- Engage in all phases of the development life cycle, including design, implementation, testing, delivery, documentation, support, and maintenance.

- Determine best practices for creating data lineage from a range of data sources by analyzing source data systems. data sources.

- Build and support a modern data architecture that integrates a wide range of available AWS data technologies

BASIC QUALIFICATIONS

- 2+ years of data engineering experience

- Experience with data modeling, warehousing and building ETL pipelines

- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)

- Experience with one or more scripting language (e.g., Python, KornShell)

- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions

PREFERRED QUALIFICATIONS

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR

- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.

- Master's degree

- Experience with data querying or modeling with SQL or Excel

- Experience writing and optimizing SQL queries with large-scale, complex datasets

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $91,200/year in our lowest geographic market up to $185,000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.

---