Sr. Azure Data Engineer
Minneapolis, Minnesota
Employer: Apex Systems
Industry:
Salary: Competitive
Job type: Part-Time
Title:Senior Data Engineer
Duration: 6 month contract, possibility to extend
Location:100% Remote
Job Description:
Do you want to impact decisions to help people live healthier lives? Are you an innovative Data Engineer who thrives on developing new solutions to solve tough challenges?
We want to achieve more in our mission of health care, and so we have to be really smart about the business of health care. At our large healthcare client, were changing the landscape of our industry. You will put your Data Engineering skills to work as you empower business partners and team members improve healthcare delivery. You will research cutting edge big data tools, and design innovative solutions to solve business problems that only a Data Engineer can. Youll be in the drivers seat on vital projects that have strategic importance to our mission of helping people live healthier lives. Yes, we share a mission that inspires. And we need your organizational talents and business discipline to help fuel that mission.
You will be part of the team who is focused on building a cutting-edge data analytics platform to support reporting requirements for the business. As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation.
This is a fully remote role based in the United States. Your counterpart team is located in Dublin, Ireland office. While there is no requirement to work in shift hours, there might be an occasional call with Dublin team which can require flexible working.
Primary Responsibilities:
• Create & maintain data pipelines using Azure & Snowflake as primary tools
• Create SQL Stored procs, Macros to perform complex transformation
• Creating logical & physical data models to ensure data integrity is maintained
• CI CD pipeline creation & automation using GIT & GIT Actions
• Tuning and optimizing data processes
• Design and build best in class processes to clean and standardize data
• Code Deployments to production environment, troubleshoot production data issues
• Modelling of big volume datasets to maximize performance for our BI & Data Science Team
• Create Docker images for various applications and deploy them on Kubernetes
Required Qualifications:
• Computer Science bachelors degree or similar
• Min 3-6 years of industry experience as a Hands-on Data engineer
• Excellent communication skills
• Excellent knowledge of SQL, Python
• Excellent knowledge of Azure Services such as - Blobs, Functions, Azure Data Factory, Service Principal, Containers, Key Vault etc.
• Excellent knowledge of Snowflake - Architecture, best practices
• Excellent knowledge of Data warehousing & BI Solutions
• Excellent Knowledge of change data capture (CDC), ETL, ELT, SCD etc.
• Knowledge of CI CD Pipelines using GIT & GIT Actions
• Knowledge of different data modelling techniques such as Star Schema, Dimensional models, Data vault
• Hands on experience on the following technologies:
o Developing data pipelines in Azure & snowflake
o Writing complex SQL queries
o Building ETL/ELT/data pipelines using SCD logic
o Exposure to Kubernetes and Linux containers (i.e. Docker)
o Related/complementary open-source software platforms and languages (e.g. Scala, Python, Java, Linux)
• Previous experience with Relational Databases (RDBMS) & Non- Relational Database
• Analytical and problem-solving experience applied to a Big Data datasets
• Good understanding of Access control and Data masking
• Experience working in projects with agile/scrum methodologies and high performing team(s)
• Exposure to DevOps methodology
• Data warehousing principles, architecture and its implementation in large environments
• Very good understanding of integration with Tableau
Preferred Qualifications:
• Design and build data pipelines (in Spark) to process terabytes of data
• Very good understanding of Snowflake integration with data visualization tool such as Tableau
• Orchestrate in Airflow the data tasks to run on Kubernetes/Hadoop for the ingestion, processing and cleaning of data
• Terraform knowledge and automation
• Create real-time analytics pipelines using Kafka / Spark Streaming
• Work on Proof of Concepts for Big Data and Data Science
• Understanding of United States Healthcare data
EEO Employer
Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or 844-463-6178 .
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico.
Duration: 6 month contract, possibility to extend
Location:100% Remote
Job Description:
Do you want to impact decisions to help people live healthier lives? Are you an innovative Data Engineer who thrives on developing new solutions to solve tough challenges?
We want to achieve more in our mission of health care, and so we have to be really smart about the business of health care. At our large healthcare client, were changing the landscape of our industry. You will put your Data Engineering skills to work as you empower business partners and team members improve healthcare delivery. You will research cutting edge big data tools, and design innovative solutions to solve business problems that only a Data Engineer can. Youll be in the drivers seat on vital projects that have strategic importance to our mission of helping people live healthier lives. Yes, we share a mission that inspires. And we need your organizational talents and business discipline to help fuel that mission.
You will be part of the team who is focused on building a cutting-edge data analytics platform to support reporting requirements for the business. As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation.
This is a fully remote role based in the United States. Your counterpart team is located in Dublin, Ireland office. While there is no requirement to work in shift hours, there might be an occasional call with Dublin team which can require flexible working.
Primary Responsibilities:
• Create & maintain data pipelines using Azure & Snowflake as primary tools
• Create SQL Stored procs, Macros to perform complex transformation
• Creating logical & physical data models to ensure data integrity is maintained
• CI CD pipeline creation & automation using GIT & GIT Actions
• Tuning and optimizing data processes
• Design and build best in class processes to clean and standardize data
• Code Deployments to production environment, troubleshoot production data issues
• Modelling of big volume datasets to maximize performance for our BI & Data Science Team
• Create Docker images for various applications and deploy them on Kubernetes
Required Qualifications:
• Computer Science bachelors degree or similar
• Min 3-6 years of industry experience as a Hands-on Data engineer
• Excellent communication skills
• Excellent knowledge of SQL, Python
• Excellent knowledge of Azure Services such as - Blobs, Functions, Azure Data Factory, Service Principal, Containers, Key Vault etc.
• Excellent knowledge of Snowflake - Architecture, best practices
• Excellent knowledge of Data warehousing & BI Solutions
• Excellent Knowledge of change data capture (CDC), ETL, ELT, SCD etc.
• Knowledge of CI CD Pipelines using GIT & GIT Actions
• Knowledge of different data modelling techniques such as Star Schema, Dimensional models, Data vault
• Hands on experience on the following technologies:
o Developing data pipelines in Azure & snowflake
o Writing complex SQL queries
o Building ETL/ELT/data pipelines using SCD logic
o Exposure to Kubernetes and Linux containers (i.e. Docker)
o Related/complementary open-source software platforms and languages (e.g. Scala, Python, Java, Linux)
• Previous experience with Relational Databases (RDBMS) & Non- Relational Database
• Analytical and problem-solving experience applied to a Big Data datasets
• Good understanding of Access control and Data masking
• Experience working in projects with agile/scrum methodologies and high performing team(s)
• Exposure to DevOps methodology
• Data warehousing principles, architecture and its implementation in large environments
• Very good understanding of integration with Tableau
Preferred Qualifications:
• Design and build data pipelines (in Spark) to process terabytes of data
• Very good understanding of Snowflake integration with data visualization tool such as Tableau
• Orchestrate in Airflow the data tasks to run on Kubernetes/Hadoop for the ingestion, processing and cleaning of data
• Terraform knowledge and automation
• Create real-time analytics pipelines using Kafka / Spark Streaming
• Work on Proof of Concepts for Big Data and Data Science
• Understanding of United States Healthcare data
EEO Employer
Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or 844-463-6178 .
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico.
Created: 2024-04-10
Reference: 2020376
Country: United States
State: Minnesota
City: Minneapolis
ZIP: 55403
Similar jobs:
-
Data Engineer
Saxon Global in [minneapolis, Mn], Minnesota -
Manager, Analytics and Data Engineer - Remote
UnitedHealth Group in Minnetonka, Minnesota💸 $190400 per year -
Lead Data Engineer
Innova solutions in Raleigh, Minnesota💸 $106000 - $124500 per year -
IT-Sr Data Engineer/28/TEC044
Saxon Global in [eden Prairie, Mn, 55121], Minnesota -
Data Engineer - 2222820
UnitedHealth Group in Eden Prairie, Minnesota💸 $158025.7 per year -
Data Engineer
UnitedHealth Group in Eden Prairie, Minnesota -
Director, Data Engineering - Remote
UnitedHealth Group in Plymouth, Minnesota💸 $234700 per year -
Sr Data Engineer
General Mills in Minneapolis, Minnesota💸 $129147 - $174600. per year -
Data Engineer - Remote
Mayo Clinic in Rochester, Minnesota💸 $93204.80 per year -
Snowflake Data Engineer
Saxon Global in [eden Prairie Or Remote, Mn, 55347], Minnesota -
Sr. Data Engineer
Improving Enterprises, Inc. in Minneapolis, Minnesota -
Process Data Engineer
Danaher Corporation in New Brighton, Minnesota -
Senior Data Engineer - Generative AI
Mayo Clinic in Rochester, Minnesota💸 $134888.00 per year -
Data Engineer
Saxon Global in [minneapolis, Mn], Minnesota -
ADF ETL Data Engineer
Compunnel in Minneapolis, Minnesota -
Sr Data Engineer
General Mills in Minneapolis, Minnesota💸 $140358 - $174600. per year -
Data Engineer
Saxon Global in [eden Prairie, Mn, 53341], Minnesota -
Senior Network Engineer - Data Center
General Dynamics Corporation in Eagan, Minnesota -
Lead Data Engineer
Ascent Services Group in Raleigh, Minnesota💸 $106000 - $124500 per year -
Principal Data Engineering, SAS - Remote
UnitedHealth Group in Eden Prairie, Minnesota💸 $101200 - $184000 per year