Data Engineer (Azure Databricks)

An employer is looking for a Data Engineer for a hybrid, contract-to-hire opportunity in the Cincinnati, Ohio area. The client is a large retail company, and this person will be supporting the Enterprise Supplier Solutions space. They will be brought on to support a platform that has been built out in Azure Data Factory. Need to be very well versed in Databricks with Medallion Architecture - Moving from bronze to silver to gold then serving up in unity catalog. This person will work in a hybrid work environment required to go on site two days per week.

Responsibilities include, but are not limited to:

Develop and implement data pipelines for movement of data through the layers based on team & enterprise standards.

Implement & perform unit testing, system integration testing, regression testing and assist with user acceptance testing.

Adhere to established standards and best practices and provide input for improvement of those processes.

Self-motivated team player who can work with minimal supervision and can adapt to a quickly changing environment.

Ability to work on multiple tasks simultaneously, ability to switch between tasks and work in conflicting priorities.

Tooling & Platforms include, but not limited to: Azure Databricks, Databricks Workflows, Databricks Delta Live Tables, Databricks Unity Catalog, Delta Lake, Azure Data Factory (ingestion & orchestration), ADLS Gen 2, Azure SQL Database, Azure CosmosDB, Neo4j, Apache Spark, PySpark, Spark SQL, SQL, PL/SQPl, Oracle Database Technologies (19c), Kafka, REST APIs, Alation, Terraform

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Required Skills & Experience

4+ years of experience in a Data Engineering role

2-3 years of Hands on Experience working with in Azure Databricks including workflows, Delta Live Tables and Databricks Unity Catalog

Familiarity with ETL/ELT in Databricks and with Medallion architecture

SQL, PySpark, Python

Spark SQL

Nice to Have Skills & Experience

Oracle Database Technologies

Kafka

Terraform

Databricks Certified Data Engineer Associate

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.