Data Engineer
Columbia University Medical Center, New York
Employer: Columbia University
Industry: CUIMC IT
Salary: $85000 - $110000 per year
Job type: Full-Time
- Job Type: Officer of Administration
- Regular/Temporary: Regular
- Hours Per Week: 35
- Salary Range: $85K - $110K
The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departmental budgets, qualifications, experience, education, licenses, specialty, and training. The above hiring range represents the University's good faith and reasonable estimate of the range of possible compensation at the time of posting.
Position Summary
Reporting to the Assistant Director of CUIMC Analytics Data Engineering Team, the Data Engineer collaboratively supports and expands CUIMC Analytics' data infrastructure. This involves developing and managing numerous data processes, including, but not limited to, ETL (Extract, Transfer, Load), file movement, Cognos cube builds, and associated supporting technologies. This position works closely with the development team to deploy and test code in a SQL Server based dev/test/prod data warehouse environment. This position will create, schedule, and monitor complex data workflows using automation software, working with internal and external colleagues to quickly troubleshoot and resolve any issues that arise. This individual must be team oriented and possess strong customer service, communication, problem solving, and critical thinking skills.
Responsibilities
- Automation: Develop and maintain complex data workflows that keep our data warehouse environment up to date, secure, and accessible using automation and scheduling software, as well as scripting and other technologies - 25%
- Process Monitoring and Troubleshooting: Monitor the data infrastructure, including all automated processes, for any issues that arise, such as process or system error/failure, quickly addressing the problem as needed - 25%
- DevOps: Work closely with the Development team to deploy code using GitLab version control in dev/test/prod environment - 15%
- ETL Development: Develop new and maintain legacy ETL workflows - 15%
- Database Administration: Develop and maintain SQL Server instances in a dev/test/prod data warehouse environment - 10%
- Continuous Improvement: Seeks out additional training to improve skills in the team's technologies and new technologies, and to improve soft skills for better client and team relations - 5%
- Other Duties as Assigned - 5%
Minimum Qualifications
- Requires a bachelor's degree in a quantitative discipline, plus 3 years of experience or the equivalent in education and experience.
- Proficiency in writing and tuning SQL queries and creating SQL objects.
- Knowledge of a scripting language, such as PowerShell or Python.
- Experience with ETL applications, such as IBM DataStage, Microsoft SSIS, or others.
- Experience with automation/scheduling applications, such as Fortra Automate, Automize, or others.
- Ability to think logically and troubleshoot expeditiously.
Preferred Qualifications
- Excellent decision making, critical thinking, and problem-solving skills.
- Strong organizational skills with an emphasis on communication, detail, and follow-up.
- Experience in academic or hospital environments.
- Process improvement and efficiency mindset.
- Experience with SQL Server.
- Experience with Docker or other containers.
- Experience with AWS services, such as EC2, Lambda, IAM.
- Experience using APIs.
Equal Opportunity Employer / Disability / Veteran
Columbia University is committed to the hiring of qualified local residents.
Commitment to Diversity
Columbia University is dedicated to increasing diversity in its workforce, its student body, and its educational programs. Achieving continued academic excellence and creating a vibrant university community require nothing less. In fulfilling its mission to advance diversity at the University, Columbia seeks to hire, retain, and promote exceptionally talented individuals from diverse backgrounds.
Created: 2024-05-04
Reference: 542823
Country: United States
State: New York
City: Columbia University Medical Center
Similar jobs:
-
Sr Data Engineer, Creators
Amazon in New York, New York💸 $123700 per year -
UK Onsite Senior Data Engineer
Insight Global in New York, New York -
Evidence Lab Data & Analytics Software Engineer
UBS in New York, New York -
Data Engineer
American Express in New York, New York -
Data Engineer
Meta in New York, New York -
Data Engineer, Global Payments - USDS
TikTok in New York, New York -
Data Support Engineer
Delaware North in Buffalo, New York💸 $66500 - $89900 per year -
Engineering Team Lead - Data Platform - Artificial Intelligence
Bloomberg LP in New York, New York -
Data Engineer
Phyton Talent Advisors in New York, New York -
Data Engineer
Open Systems Technologies in New York City, New York💸 $115000 - $160000 per year -
Senior Quality Engineer - JavaScript - Agile - U.S. Consumer Services and Enterprise Digital & Data Technology
American Express in New York, New York💸 $110000.00 per year -
Data Engineer
Meta in New York, New York -
Data Engineer, GMS
Meta in New York, New York -
Senior Machine Learning Engineer - Data Curation - AIGC, TikTok Monetization GenAI
TikTok in New York, New York -
Data Defense Solutions Engineer
TikTok in New York, New York -
Senior Engineer - Java - Enterprise Data Management
American Express in New York, New York💸 $110000.00 per year -
Data Engineer I
INTELLISWIFT INC in New York, New York💸 $50 per hour -
Data Engineer
Open Systems Technologies in New York, New York💸 $70 - $100 per hour -
Senior Data Management Professional - Data Engineering - Company Financials BI
Bloomberg LP in New York, New York -
Data Engineer Levels 1-3
Metropolitan Transportation Authority in New York, New York💸 $67172 - $88163 per year