Azure Data Engineering Manager (Hybrid to Charlotte, NC)
Charlotte, North Carolina
Employer: Insight Global
Industry: Data Warehousing
Salary: Competitive
Job type: Part-Time
A client in Charlotte, NC is looking for Azure Data Engineering Manager to join their team. As the Manager, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering the organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers (onshore and offshore), fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities. Responsibilities are shown below:
Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc
Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
12+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses
2+ years of experience working as a Manager
Strong proficiency in SQL, specifically being able to handle window functions like rank, average, standard deviation
Python and PySpark programming languages
Strong experience with the Azure cloud platform
Experience working in a retail environment
Extensive experience working with Databricks and Azure Data Factory for data lake and data warehouse solutions
Experience in implementing CI/CD pipelines for automating build, test, and deployment processes
Hands-on experience with big data technologies (such as Hadoop, Spark, Kafka)
Nice to Have Skills & Experience
Prior experience on working with offshore team (India, Europe, etc.)
Relevant certifications (e.g., Azure, Databricks, Snowflake) would be a plus
Experience working with Snowflake and/or Microsoft Fabric
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc
Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
12+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses
2+ years of experience working as a Manager
Strong proficiency in SQL, specifically being able to handle window functions like rank, average, standard deviation
Python and PySpark programming languages
Strong experience with the Azure cloud platform
Experience working in a retail environment
Extensive experience working with Databricks and Azure Data Factory for data lake and data warehouse solutions
Experience in implementing CI/CD pipelines for automating build, test, and deployment processes
Hands-on experience with big data technologies (such as Hadoop, Spark, Kafka)
Nice to Have Skills & Experience
Prior experience on working with offshore team (India, Europe, etc.)
Relevant certifications (e.g., Azure, Databricks, Snowflake) would be a plus
Experience working with Snowflake and/or Microsoft Fabric
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Created: 2024-08-27
Reference: 376657
Country: United States
State: North Carolina
City: Charlotte
ZIP: 28269
Similar jobs:
-
Engineering Manager - Master Data
Retail Business Services in Salisbury, North Carolina -
Engineering Manager - Water/Wastewater - Winston-Salem
Black and Veatch in Winston-Salem, North Carolina -
Distribution Engineering Manager
Leidos Holding in Asheville, North Carolina💸 $87100.00 per year -
Electrical Engineering Manager
Oxford Global Resources in Charlotte, North Carolina -
Senior Manager, IT Engineering
Meltwater in Charlotte, North Carolina💸 $160000 - $175000 per year -
Solutions Engineering Manager- Martech/Adtech
Retail Business Services in Salisbury, North Carolina -
Site Civil Engineering Team Manager
HDR in Raleigh, North Carolina -
Project Manager - Water Engineering
Stantec in CHARLOTTE, North Carolina -
Technical Manager - Cloud Security Engineering
Vanguard Group in Charlotte, North Carolina -
Manager, Project Controls Engineering
Precision for Medicine in Raleigh, North Carolina -
Project Manager with AWS Engineering exp. (Onsite)
Cognizant Technology Solutions in Charlotte, North Carolina💸 $115500.00 per year -
Clinical Engineering Manager
AdventHealth in Hendersonville, North Carolina -
Sr. Engineering Manager - Water/Wastewater - Charlotte
Black and Veatch in Charlotte, North Carolina -
Senior Manager IT Solutions Engineering- POS & Payments
Retail Business Services in Salisbury, North Carolina -
Datacenter Engineering Principal Design Manager
Microsoft in Charlotte, North Carolina💸 $137600 per year -
Engineering Manager
Abb Holdings Inc in Mebane, North Carolina -
Engineering Manager - Water/Wastewater - Charlotte, NC
Black and Veatch in Charlotte, North Carolina -
Project Coordinator (Engineering-Project Management )
Experis in Auburn, North Carolina💸 $30 per hour -
Senior Engineering Manager - Water and Wastewater *Hybrid Raleigh, NC*
Black and Veatch in Cary, North Carolina -
Senior Engineering Manager - Water and Wastewater *Hybrid Charlotte, NC*
Black and Veatch in Charlotte, North Carolina