Data Engineer

Columbia University Medical Center, New York


Employer: Columbia University
Industry: CUIMC IT
Salary: $85000 - $110000 per year
Job type: Full-Time

  • Job Type: Officer of Administration
  • Regular/Temporary: Regular
  • Hours Per Week: 35
  • Salary Range: $85K - $110K

The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departmental budgets, qualifications, experience, education, licenses, specialty, and training. The above hiring range represents the University's good faith and reasonable estimate of the range of possible compensation at the time of posting.

Position Summary

Reporting to the Assistant Director of CUIMC Analytics Data Engineering Team, the Data Engineer collaboratively supports and expands CUIMC Analytics' data infrastructure. This involves developing and managing numerous data processes, including, but not limited to, ETL (Extract, Transfer, Load), file movement, Cognos cube builds, and associated supporting technologies. This position works closely with the development team to deploy and test code in a SQL Server based dev/test/prod data warehouse environment. This position will create, schedule, and monitor complex data workflows using automation software, working with internal and external colleagues to quickly troubleshoot and resolve any issues that arise. This individual must be team oriented and possess strong customer service, communication, problem solving, and critical thinking skills.

Responsibilities
  • Automation: Develop and maintain complex data workflows that keep our data warehouse environment up to date, secure, and accessible using automation and scheduling software, as well as scripting and other technologies - 25%
  • Process Monitoring and Troubleshooting: Monitor the data infrastructure, including all automated processes, for any issues that arise, such as process or system error/failure, quickly addressing the problem as needed - 25%
  • DevOps: Work closely with the Development team to deploy code using GitLab version control in dev/test/prod environment - 15%
  • ETL Development: Develop new and maintain legacy ETL workflows - 15%
  • Database Administration: Develop and maintain SQL Server instances in a dev/test/prod data warehouse environment - 10%
  • Continuous Improvement: Seeks out additional training to improve skills in the team's technologies and new technologies, and to improve soft skills for better client and team relations - 5%
  • Other Duties as Assigned - 5%

Minimum Qualifications
  • Requires a bachelor's degree in a quantitative discipline, plus 3 years of experience or the equivalent in education and experience.
  • Proficiency in writing and tuning SQL queries and creating SQL objects.
  • Knowledge of a scripting language, such as PowerShell or Python.
  • Experience with ETL applications, such as IBM DataStage, Microsoft SSIS, or others.
  • Experience with automation/scheduling applications, such as Fortra Automate, Automize, or others.
  • Ability to think logically and troubleshoot expeditiously.

Preferred Qualifications
  • Excellent decision making, critical thinking, and problem-solving skills.
  • Strong organizational skills with an emphasis on communication, detail, and follow-up.
  • Experience in academic or hospital environments.
  • Process improvement and efficiency mindset.
  • Experience with SQL Server.
  • Experience with Docker or other containers.
  • Experience with AWS services, such as EC2, Lambda, IAM.
  • Experience using APIs.

Equal Opportunity Employer / Disability / Veteran

Columbia University is committed to the hiring of qualified local residents.

Commitment to Diversity

Columbia University is dedicated to increasing diversity in its workforce, its student body, and its educational programs. Achieving continued academic excellence and creating a vibrant university community require nothing less. In fulfilling its mission to advance diversity at the University, Columbia seeks to hire, retain, and promote exceptionally talented individuals from diverse backgrounds.

Created: 2024-05-04
Reference: 542823
Country: United States
State: New York
City: Columbia University Medical Center


Similar jobs: