Data Engineer II
Phoenix, Arizona
Employer: Insight Global
Industry: Data Warehousing
Salary: Competitive
Job type: Full-Time
*MUST BE LOCAL TO ARIZONA*
Description
You will be an independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven for our client. Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production. At our client, they understand that our data does not reach its full potential until it is analyzed, and insights effectively communicated to the enterprise. You will work in close collaboration with mining operations, subject matter experts, data scientists, and software engineers to develop advanced, highly automated data products. You will be a champion of DataOps, and agile practices; actively participating in project teams to drive value.
* Agile Project Work: Work in cross-functional, geographically distributed agile teams of highly skilled data engineers, software/machine learning engineers, data scientists, DevOps engineers, designers, product managers, technical delivery teams, and others to continuously innovate analytic solutions.
o Design, develop, and review real-time/bulk data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages, images, video, etc)
o Follow established design patterns for data ingest, transformation, and egress
o Develop documentation of Data Lineage and Data Dictionaries to create a broad awareness of the enterprise data model and its applications
o Apply best practices within DataOps (Version Control, P.R. Based Development, Schema Change Control, CI/CD, Deployment Automation, Test Automation, Shift left on Security, Loosely Coupled Architectures, Monitoring, Proactive Notifications)
* Problem Solving/Project Management: Constructively challenge while soliciting participation in problem solving to enrich possible solutions.
* Architecture: Utilize modern cloud technologies and employ best practices from DevOps/DataOps to produce enterprise quality production Python and SQL code with minimal errors. Participate in regular code review sessions and collaboratively discuss opportunities for continuous improvement in all solutions.
* Self-Development: Flexibly seek out new work or training opportunities to broaden experience. Independently research latest technologies and openly discuss applications within the department.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
Minimum Requirements:
* Bachelor's degree in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline
* 6+ years of experience as a Data Engineer
* Strong coding skills in SQL
* Working knowledge of Azure (Including Azure Stream Architectures, DBT, Schema Change tools, Data Dictionary tools, Azure Machine Learning Environment, GIS Data)
* Strong experience in data management, data modeling concepts, data architecture
* Experience with Snowflake
* Experience with Databricks
* Working knowledge of Software Engineering and Object Orient Programming Principles
* Experience with coding Python
* Working knowledge of problem solving/root cause analysis on Production workloads
* Working knowledge of Agile, Scrum, and Kanban
* Working knowledge of workflow orchestration using tools such as Airflow, Prefect, Dagster, or similar tooling
* Working knowledge with CI/CD and automation tools like Jenkins or Azure DevOps
* Experience with containerization tools such as Docker
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Description
You will be an independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven for our client. Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production. At our client, they understand that our data does not reach its full potential until it is analyzed, and insights effectively communicated to the enterprise. You will work in close collaboration with mining operations, subject matter experts, data scientists, and software engineers to develop advanced, highly automated data products. You will be a champion of DataOps, and agile practices; actively participating in project teams to drive value.
* Agile Project Work: Work in cross-functional, geographically distributed agile teams of highly skilled data engineers, software/machine learning engineers, data scientists, DevOps engineers, designers, product managers, technical delivery teams, and others to continuously innovate analytic solutions.
o Design, develop, and review real-time/bulk data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages, images, video, etc)
o Follow established design patterns for data ingest, transformation, and egress
o Develop documentation of Data Lineage and Data Dictionaries to create a broad awareness of the enterprise data model and its applications
o Apply best practices within DataOps (Version Control, P.R. Based Development, Schema Change Control, CI/CD, Deployment Automation, Test Automation, Shift left on Security, Loosely Coupled Architectures, Monitoring, Proactive Notifications)
* Problem Solving/Project Management: Constructively challenge while soliciting participation in problem solving to enrich possible solutions.
* Architecture: Utilize modern cloud technologies and employ best practices from DevOps/DataOps to produce enterprise quality production Python and SQL code with minimal errors. Participate in regular code review sessions and collaboratively discuss opportunities for continuous improvement in all solutions.
* Self-Development: Flexibly seek out new work or training opportunities to broaden experience. Independently research latest technologies and openly discuss applications within the department.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Required Skills & Experience
Minimum Requirements:
* Bachelor's degree in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline
* 6+ years of experience as a Data Engineer
* Strong coding skills in SQL
* Working knowledge of Azure (Including Azure Stream Architectures, DBT, Schema Change tools, Data Dictionary tools, Azure Machine Learning Environment, GIS Data)
* Strong experience in data management, data modeling concepts, data architecture
* Experience with Snowflake
* Experience with Databricks
* Working knowledge of Software Engineering and Object Orient Programming Principles
* Experience with coding Python
* Working knowledge of problem solving/root cause analysis on Production workloads
* Working knowledge of Agile, Scrum, and Kanban
* Working knowledge of workflow orchestration using tools such as Airflow, Prefect, Dagster, or similar tooling
* Working knowledge with CI/CD and automation tools like Jenkins or Azure DevOps
* Experience with containerization tools such as Docker
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Created: 2024-05-04
Reference: 347976
Country: United States
State: Arizona
City: Phoenix
ZIP: 85008
Similar jobs:
-
Engineer - Big Data - Personalization
American Express in Phoenix, Arizona -
Data Engineer
TriWest Healthcare in Phoenix, Arizona💸 $100000 - $127000 per year -
Senior Data Engineer - Work From Home
Parallel Partners in Phoenix, Arizona -
INTL Data Software Engineers (India)
Insight Global in Phoenix, Arizona -
Data Engineer - SQL/GCP services - Next gen Big data
American Express in Phoenix, Arizona -
Senior Engineer - Python/ JAVA / Big Data / Spark / Hive/ Hbase / SQL/ NoSQL - Enterprise Data Management and AIML Engineering
American Express in Phoenix, Arizona💸 $110000.00 per year -
Data Software Engineer
Insight Global in Phoenix, Arizona -
Data Engineer Senior
TriWest Healthcare in Phoenix, Arizona💸 $138000 - $154000 per year -
Snowflake Data Engineer with DBT
Infosys Limited Digital in Hartford, Arizona -
Director, Data Center Infrastructure (DCI) - Facilities Engineering & Construction
American Express in Phoenix, Arizona💸 $170000.00 per year -
Sr. Data Engineer
Saxon Global in [phoenix, Az, 85040], Arizona -
Junior Big Data Engineer
Saxon Global in [phoenix, Az], Arizona -
Data Engineer - SQL/GCP services - Next gen Big data
American Express in Phoenix, Arizona -
Big Data Engineer
Saxon Global in [phoenix, Az, 85050], Arizona -
Sr Data Engineer
BCforward in Paradise Valley, Arizona -
DATA ENGINEER II, AWS Data Platform
Amazon in Tempe, Arizona -
Senior Data Engineer
American Express in Phoenix, Arizona💸 $110000.00 per year -
Snowflake Data Engineer
Saxon Global in [phoenix, Az, 85001], Arizona -
Data Engineer
American Express in Phoenix, Arizona -
Senior Engineer - Java - Springboot/ Python / GraphQL / Rest API /SQL - Enterprise Data Management & Architecture
American Express in Phoenix, Arizona💸 $110000.00 per year