Data Engineer

Chicago, Illinois


Employer: Compunnel
Industry: 
Salary: Competitive
Job type: Part-Time

Job Summary:

We are seeking a skilled ADF Data Engineer to join our dynamic healthcare team. 

In this role, you will leverage your expertise in Azure Data Factory (ADF) and EPIC systems to design, implement, and maintain data integration and transformation solutions that support our healthcare operations. 

Your work will ensure seamless data flow, enhance data quality, and enable actionable insights that drive better patient care and operational efficiency.

Top 3 requirements: 

One role focused on DBT

Python

SQL

Azure Cloud Experience

Snowflake (plus)

Healthcare experience (plus, not necessary)

Day to Day Responsibilities/project specifics:

The team is looking for 2 Azure Data Engineers.

One engineer will focus on DBT.

Both candidates will have some overlap of work.

The DBT Engineer will focus on the transformations

The Engineers will work with CSV, JSON, and YAML files mostly coming from Epic but there will be other data sources as well.

The primary focus for the engineers will be data ingestion and transformation, with the overarching goal of automating the processes using Python scripts/code.

Client wants the engineers to use Python for these - Client wants them to use python libraries to leverage and streamline the process

D2D:

Pivot and unpivot data

Parsing unstructured changes and vendor upgrades

Use Python to automate tasks - to transform and filter large datasets and extract changes

Python goal is to automate data ingestion and data transformation

DBT engineer will establish data lineage from transformations, flatten files and create structures

ADF engineer will focus on the data pools,

Education: Bachelors Degree

Created: 2024-09-14
Reference: PATDC5033192
Country: United States
State: Illinois
City: Chicago
ZIP: 60018


Similar jobs: