Lead Data Engineer

Phoenix, Arizona


Employer: Sayva Solutions
Industry: Technology
Salary: Competitive
Job type: Full-Time

Lead Data Engineer

About the Opportunity:
Our team has partnered with a SaaS company focused on improving transportation safety and efficiency seeking a "Lead Data Engineer" with expertise in designing and building large-scale database solutions. This is a hands-on manager (~50/50 programming vs. management) with 5 direct reports. 2+ years of direct management experience is preferred.

Salary: $150k - 175k + 10% bonus DOE + benefits (health/dental/vision, 401k match, etc.)

Location: 2-day Hybrid in Phoenix, Arizona

Responsibilities:
  • Design and implement highly scalable, distributed architectures using Azure Databricks, Delta Lake, and other Microsoft Azure services.
  • Serve as a technical authority, lead projects, and optimize production systems to ensure reliability, performance, scalability, and security.
  • Collaborate with Product Management and Engineering leadership to architect and build solutions that align with roadmap features.
  • Implement best practices in Microsoft Azure for data quality, governance, security, lineage, and cataloging.
  • Mentor and guide junior engineers.
  • Lead a team of approximately 5 engineers.
  • Monitor workflows and compute to identify opportunities for efficiency improvements and cost reductions.
  • Develop comprehensive solutions for orchestration and monitoring.
  • Troubleshoot system issues, prioritize fixes, and delegate tasks within the team.
  • Oversee and manage code releases to production.
  • Lead prototyping efforts to demonstrate the value and feasibility of solutions and architectures.

Required:
  • Bachelor`s degree in engineering or an equivalent degree.
  • 8+ years of experience designing and building large-scale database solutions.
  • 3+ years of experience programming in Python and PySpark.
  • 2+ years of direct management experience is preferred.
  • Expertise with SQL.
  • Extensive experience building ETL/ELT solutions.
  • 1+ year of experience with Azure Databricks / Azure Data Factory minimum.
  • Data visualization experience (ideally PowerBI).
  • Experience designing data structures and models for data lakes.
  • Deep understanding of distributed storage and computing.
  • Proficiency with SSIS.
  • Knowledge of software production engineering practices, including version control, code peer reviews, automated testing, and CI/CD.

Preferred Qualifications
  • ML and AI experience.
  • Event driven architecture experience.
  • DevOps CI/CD implementation experience.
  • Experience with both batch and streaming data sources.
  • Familiarity with No-SQL databases.
  • Knowledge of event-driven architecture, including queues, batches, and pub/sub models.
  • Experience working with data from enterprise systems like ERPs and CRMs.

Benefits & Selling Points:
  • Flexible hybrid schedule in Phoenix, AZ with a highly collaborative team, a beautiful office across the stadium, and excellent equipment.
  • Comprehensive benefits (Medical, Dental, Vision, 401k with match, etc.).
  • Play a key role in formulating the design, development, and implementation of their cloud-native data architecture.
  • Work with cutting edge technology with technical freedom to explore and expand on existing skills.
  • Growing company with a great culture - opportunity to make a big impact and establish your footprint within data engineering.

About Sayva: Sayva Solutions is an accounting, finance, technology, and human resources professional services firm whose focus is on long term relationships created through teamwork and doing what is in the best interest of others. By working with Sayva to identify your next career move, you will get the benefit of working with an experienced team who not only has a strong network of trusted clients, but expertise in the markets, and functions, we serve. We can provide insight on what your market value is, what companies have to offer, and what opportunities align best with your professional and personal goals. We are your trusted advisor throughout your search process and can help ensure you are prepared for interviews, have the information to make the best decisions, and receive a strong offer to land you that perfect job. Making a career move is not easy and can be stressful; Sayva can be your partner in making the process smooth, transparent, and rewarding.

#LI-JE1

Created: 2024-09-11
Reference: 6893
Country: United States
State: Arizona
City: Phoenix
ZIP: 85008


Similar jobs: