Senior Data Engineer
New York, New York
Employer: Northwell Health
Industry: Information Technology and Services
Salary: $112800 - $197200 per year
Job type: Full-Time
Job Description
Works directly with the Data Science and Predictive Analytics team to advance data engineering and infrastructure within Northwell, as well as migrate and support machine learning projects in production. Defines and builds the next iteration of features for the Data Science team and is responsible for modifying, expanding, and optimizing our data warehousing to include feature stores, big data, and cloud technologies. Works collaboratively with members from both the Information Technology and clinical functions to support data scientists, systems and initiatives at both the department and the enterprise level.
Job Responsibility
Job Qualification
*Additional Salary Detail
The salary range and/or hourly rate listed is a good faith determination of potential base compensation that may be offered to a successful applicant for this position at the time of this job advertisement and may be modified in the future.When determining a team member's base salary and/or rate, several factors may be considered as applicable (e.g., location, specialty, service line, years of relevant experience, education, credentials, negotiated contracts, budget and internal equity).
The salary range for this position is $112,800-$197,200/year
Salary ranges shown on third-party job sites may not accurately reflect ranges provided by Northwell Health. Candidates should check Northwell Health Careers for accurate information and discuss salary/hourly details and our comprehensive benefits with a recruiter, if selected for an interview.
Works directly with the Data Science and Predictive Analytics team to advance data engineering and infrastructure within Northwell, as well as migrate and support machine learning projects in production. Defines and builds the next iteration of features for the Data Science team and is responsible for modifying, expanding, and optimizing our data warehousing to include feature stores, big data, and cloud technologies. Works collaboratively with members from both the Information Technology and clinical functions to support data scientists, systems and initiatives at both the department and the enterprise level.
Job Responsibility
- Manages and coordinates implementation of systems and processes to meet user requirements; communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility; develops system specifications that appropriately meet department requirements.
- Builds and maintains infrastructure for data management and assembles datasets from disparate sources to meet team requirements.
- Maintains data acquisition process and data pipelines; verifies data quality, and/or ensures it via data cleaning and processing. Develops and optimizes ETL processes, implements transformations and quality checks results.
- Designs, develops, and maintains data pipelines between serves, databases, and other sources to support Data Science research and development and production pipelines.
- Identifies, designs, and implements process improvements for optimization, efficiency, greater scalability, and automation.
- Develops and shares best practices for code quality, versioning, repository, documentation, and data flows among the Data Science team.
- Assists data scientists, engineers, cloud architects, and subject matter advisors in testing, deploying, and maintaining artificial intelligence and machine learning algorithms.
- Facilitates deployment of machine learning and other models to production; monitors performance and health; and updates/retrains models.
- Works collaboratively to develop, construct, test, and maintain large scale data processing systems and databases.
- Maintains development and production environments, both on-premises and cloud-based.
- Participates in projects to architect (research, recommend, design, develop and deploy) advanced systems for the collection, aggregation and analysis of those data in alignment with business objectives.
- Provides big data technology assessments, strategies, and roadmaps in several technical domains and act as a subject matter advisor on big data.
- Works with cross functional research leadership, technical and analytical teams to understand current and future enterprise-wide big data analytics goals spanning disparate platforms and datatypes.
- Assists in ensuring that systems are implemented to support Health System initiatives and goals to improve the quality of patient care, to maximize patient safety, and to provide operational efficiencies.
- Demonstrates familiarity with current health system information systems.
- Operates under limited guidance and work assignments involve moderately complex to complex issues where the analysis of situations or data requires in-depth evaluation of variable factors.
- Makes decisions on moderately complex to complex issues regarding technical approach and completion of own tasks/responsibilities of substantial complexity.
- Performs related duties as required. All responsibilities noted here are considered essential functions of the job under the Americans with Disabilities Act. Duties not mentioned here, but considered related are not essential functions.
Job Qualification
- Bachelor's Degree in Computer Science, Informatics, Statistics, Engineering, Data Science, or relative quantitative field required, or equivalent combination of education and related experience. Master's Degree, preferred.
- 3-5 years of experience with enterprise level design and implementation of relational databases, big data pipelines, cloud computing, and other advanced data science and big data technologies, required.
- Advanced working knowledge and experience with SQL and relational databases, required. Strong knowledge and experience using the following software and tools, required: SQL/NoSQL, Python, R, Spark, Git, data pipeline tools (e.g., Airflow), cloud infrastructure (Microsoft Azure preferred).
- Experience in building and optimizing data pipelines; deploying and maintaining production machine learning algorithms; and building, testing, and deploying code on cloud infrastructure, required.
- Experience with managing healthcare data, preferred.
- Experience with managing unstructured data and streaming data, preferred.
- Experience in architecting data warehouses and/or data lakes with traditional database enterprise-class RDBMS technologies, preferred.
- Strong knowledge of Business Intelligence & Analytics concepts and platforms, inclusive of data virtualization, data preparation, data visualization and advanced analytics technologies, preferred.
*Additional Salary Detail
The salary range and/or hourly rate listed is a good faith determination of potential base compensation that may be offered to a successful applicant for this position at the time of this job advertisement and may be modified in the future.When determining a team member's base salary and/or rate, several factors may be considered as applicable (e.g., location, specialty, service line, years of relevant experience, education, credentials, negotiated contracts, budget and internal equity).
The salary range for this position is $112,800-$197,200/year
Salary ranges shown on third-party job sites may not accurately reflect ranges provided by Northwell Health. Candidates should check Northwell Health Careers for accurate information and discuss salary/hourly details and our comprehensive benefits with a recruiter, if selected for an interview.
Created: 2024-09-20
Reference: 21036515
Country: United States
State: New York
City: New York
ZIP: 10036
Similar jobs:
-
Data Engineering Co-op - Fort Edward, NY - Winter - Summer 2025
J.D. Irving in Fort Edward, New York💸 $25.75 - $27.40 per hour -
Data Engineer I
INTELLISWIFT INC in New York, New York💸 $58 per hour -
Data Engineer - Data Engineer I
INSPYR Solutions in New York, New York💸 $50 - $55 per hour -
Data Defense Solutions Engineer
TikTok in New York, New York -
Data Engineer, Product Analytics
Meta in New York, New York -
Data Risk & Privacy - Data Governance - Knowledge Graph / Data Engineering - Manager
PwC in New York, New York -
Application Engineer, Enterprise Data and Engineering
Google in New York, New York💸 $102000 - $150000 per year -
Site Reliability Engineer, Data Platform - USDS
TikTok in New York, New York -
Salesforce - MuleSoft - Senior Data Engineer
Northwell Health in Lake Success, New York💸 $112800 - $197200 per year -
Senior Business Intelligence Engineer, PubTech Data, Insights \u0026 Analytics
Amazon in New York, New York💸 $117300 per year -
Senior/Lead Software Engineer - Salesforce Marketing/Data Cloud
Northwell Health in Lake Success, New York💸 $130300 - $228000 per year -
Senior Data Management Professional - Data Engineering - Sovereigns Debt Data
Bloomberg LP in New York, New York -
Jr. Web Application Data Engineer
GEI Consultants in Amherst, New York💸 $25.00 - $32.00 per hour -
Senior Data Engineer
American Express in New York, New York💸 $110000.00 per year -
Sr Engineer - JavaScript, React - U.S. Consumer Services & Enterprise Digital & Data Technology Team
American Express in New York, New York💸 $110000.00 per year -
Let's begin! Sr AWS Data Engineer (6156)
Moody's Investors Service in New York, New York💸 $184950.00 per year -
Research Data Engineer II
University of Rochester in Rochester, New York💸 $77216 - $115824 per year -
Senior Software Engineer, Front End, Google Cloud Data Management
Google in New York, New York -
Info Governance and Privacy - Data Governance & Data Engineering Sr. Associate
PwC in New York, New York -
Senior Data Engineer - 168337 DATA
Innova solutions in New York, New York💸 $65 - $70 per hour