Lead Data Engineer/Architect

Our client is a Fortune 100 telecommunications company, and this role sits within their rapidly growing mobile division. They are looking for a senior level data engineer with a desire to shift into a leadership path. Personality traits are important in this role theyre looking for someone who is capable of gathering and understanding requirements, explaining difficult concepts to others in simple terms, is curious and a quick learner. The team provides data and analytics to their product and business stakeholders to make informed decisions on their mobile and out-of-home features and offerings.

On a day-to-day basis, candidates will:
- Operate in a technical lead capacity
- Support architecture plans and concepts for data pipelines
- Participate in providing guidance and leadership in a project (mid-flight) of migrating on-prem Hadoop jobs into AWS EMR.
- Design, develop and support ETL data pipelines solutions primary in AWS environment.
- Design, develop, and maintain scaled ETL process to deliver meaningful insights from large and complicated data sets.
- Collaborate with Engineering teams to discovery and leverage new data being introduced into the environment.
- Support existing ETL processes written in SQL, troubleshoot and resolve production issues.
- Hands-on experience with orchestration of data pipelines.
- Create and maintain report specifications and process documentations as part of the required data deliverables.
- Troubleshoot and resolve data, system, and performance issues.
- Communicating with business partners, other technical teams and management to collect requirements, articulate data deliverables, and provide technical designs.
- Leverage both qualitative and quantitative data to get a complete picture of the customer experience.
- Work closely with the development team to prioritize features, refine requirements, and ensure end-to-end delivery.
- Collect, analyze, and interpret complex data sets from various sources, including product usage analytics.
- Develop and execute comprehensive test plans to validate functionality and quality.
- Oversee data architecture and ensure scalability and performance.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Required Skills & Experience
- 7-10+ years of data engineering experience
- Strong SQL skills (expert level)
- ETL
- Spark
- AWS

Nice to Have Skills & Experience
- Cable or mobile background
- Hive
- GIS/Geospatial/spatial analytics
- Scala

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.