Lead Data Engineer

Project duration: 24 months

As a Lead Data Engineer, you will use your advanced expertise to guide the development and operationalization of cloud data pipelines, ensuring data is accessible for reports, advanced analytics, and AI. Your role includes overseeing data ingestion, transformation, validation, and quality, as well as optimizing and orchestrating data pipelines. You will also manage continuous integration and deployment (CI/CD) practices, leading and mentoring a team of data engineers to deliver robust data solutions aligned with business objectives.

Qualifications:
Minimum Education
Bachelor's Degree A Bachelor's degree in a quantitative or business field (e.g., Statistics, Mathematics, Engineering, Computer Science). (Required)

Minimum Work Experience
10 years; requires deep functional knowledge with 10 years of related experience, or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. (Required)

Required Skills/Knowledge
Experience with big data; data processing and cloud technologies.
Strong experience diagnosing system issues, engaging in data validation, and providing quality assurance testing.
Experience with data manipulation; Data mining.
Experience working in production cloud infrastructure.
Experience with C# (programming language); Java (programming language); Programming concepts; Programming tools; Python (Programming Language); SQL (programming language).
Knowledge of Microsoft Azure; Databricks or equivalent.
Seeks to acquire knowledge in area of specialty.
Ability to identify basic problems and procedural irregularities, collect data, establish facts, and draw valid conclusions.
Ability to work independently.
Demonstrated analytical skills.
Demonstrated project management skills.
Demonstrates a high level of accuracy, even under pressure.
Demonstrates excellent judgment and decision-making skills.
Ability to communicate and make recommendations to upper management.
Ability to drive multiple projects to successful completion.
Possesses technical aptitude.
Excellent verbal and written communication skills, communicate complex findings in a clear and understandable manner
Excellent facilitation ability to host sessions and elicit ideas from others, understanding their issues and encourage group participation
Attention to detail.
Communicate complex findings in a clear and understandable manner
Collaborate effectively with cross-functional teams
Adapt to changing priorities and thrive in a dynamic environment

Functional Accountabilities

• Leads the design and implementation of standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, data destruction, (scripts, programs automation, assisted by automation etc.)

• Leads data engineering and provides advanced expertise in the design, development, implementation, testing, documentation, and preparation of large scale, high volume, high performance data structures for business intelligence analysts.

• Leads the team using advanced expertise and knowledge in the design, development and maintenance of real time processing applications and real time data pipelines.

• Ensure quality of technical solutions as data moves across environments.

• Provides advanced knowledge and insight into the changing cloud data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions.

• Develops, constructs, tests, and maintains architectures using advanced programming languages and tools.

• Leads and implements ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated.

• Performs other duties as assigned.

• Complies with all policies and standards.

Organizational Accountabilities
Organizational Accountabilities (Staff)
Organizational Commitment/Identification

• Anticipate and responds to customer needs; follows up until needs are met

Teamwork/Communication

• Demonstrate collaborative and respectful behavior

• Partner with all team members to achieve goals

• Receptive to others' ideas and opinions

Performance Improvement/Problem-solving

• Contribute to a positive work environment

• Demonstrate flexibility and willingness to change

• Identify opportunities to improve clinical and administrative processes

• Make appropriate decisions, using sound judgment

Cost Management/Financial Responsibility

• Use resources efficiently

• Search for less costly ways of doing things

Safety

• Speak up when team members appear to exhibit unsafe behavior or performance

• Continuously validate and verify information needed for decision making or documentation

• Stop in the face of uncertainty and takes time to resolve the situation

• Demonstrate accurate, clear and timely verbal and written communication

• Actively promote safety for patients, families, visitors and co-workers

• Attend carefully to important details - practicing Stop, Think, Act and Review in order to self-check behavior and performance