Lead Big Data Engineer
Philadelphia, Pennsylvania
Employer: Clarivate
Industry:
Salary: Competitive
Job type: Full-Time
We are looking for a Lead Big Data Engineer to join our IMS team in Philadelphia, PA. This is an exciting new opportunity to support data excellence and research intelligence projects. If you have a solid background in Big Data design and development, are metrics-focused and obsessed with CI/CD and DevOps we would love to speak with you!
About You - experience, education, skills, and accomplishments
- Bachelor's degree in computer science or equivalent experience in software development.
- Minimum 5 years of relevant experience in developing Big Data systems.
- Minimum 5 years' experience in working with all aspects of distributed processing, including Hadoop, Hive, Apache Spark and Cassandra.
- Minimum 5 years' experience coding in key technologies like Java, Apache Spark, Hive, PostgreSQL, Scala, Git, Linux, AWS, and Greenplum.
- Minimum 5 years' experience in AWS Ecosystem with hands-on knowledge of ec2, S3 and services
- Minimum 5 years' experience in working with build tools like Maven, Gradle and CI/CD tools like Jenkins.
- Minimum 5 years' experience in optimizing Big Data system performance.
It would be great if you also had . . .
- Experience in Big Data design and development
- Experience on Spark streaming
- Ability to guide developers-Front end, back end, and full-stack developers across different tech functions
- An understanding of existing complex processes and workflows
- Hands on experience with the full SDLC
- Experience working in an Agile Scrum methodology
What will you be doing in this role?
- Work closely with users, technical leads, project managers, and other cross-functional development teams to design and deliver software solutions.
- Design software solutions, making modifications to existing software and integrating applications within the core pathway.
- Must develop software using disciplined software development processes, adhering to team/company standards and software best practice guidelines, and corporate policies.
- Responsible for applying working knowledge of OO design patterns to develop enterprise level and cloud native solutions.
- Demonstrate ability of translating plain requirements into effective technical design and solutions
- Deliver quality product to our QA and be responsible for creating and executing unit tests on the code that they write for their applications.
- Able to write high-performance, reliable, and maintainable code.
- Demonstrate excellent communication and collaboration skills and has experience in working with cross functional and cross geography teams.
Hours of Work
- Full time, permanent
- Hybrid working schedule 2-3 days/week on-site
- Must live within a commutable distance to our Philadelphia, PA office
Created: 2024-05-17
Reference: JREQ126047
Country: United States
State: Pennsylvania
City: Philadelphia
ZIP: 19154
Similar jobs:
-
Data Engineer - Supply Chain Analytics
Insight Global in Collegeville, Pennsylvania -
Senior Big Data Engineer
Clarivate in Philadelphia, Pennsylvania -
Senior Data Center Engineer w/ Active TS/SCI clearance
General Dynamics Corporation in Dayton, Pennsylvania -
Databricks Data Engineer
Insight Global in Altoona, Pennsylvania -
Data Engineer
Saxon Global in [horsham, Pa], Pennsylvania -
Senior Data Platform Engineer - REMOTE
Ansys in Canonsburg, Pennsylvania -
Data Engineer
Piper Companies in Wayne, Pennsylvania💸 $120000 - $150000 per year -
Data Engineer
Veeva Systems in Philadelphia, Pennsylvania💸 $75000 - $130000 per year -
Principal Knowledge Graph Engineer, Drug Discovery Data Engineering and Solutions
Johnson & Johnson in Spring House, Pennsylvania -
AWS Data Engineer - Remote
Insight Global in West Chester, Pennsylvania -
Data Engineer
Experis in Philadelphia, Pennsylvania -
Data Center Critical Facilities Engineer - Elk Grove Village, IL - 12+ months
Open Systems Technologies in Work At Home, Pennsylvania -
Senior Application Data Engineer
Vanguard Group in Malvern, Pennsylvania -
Data Engineer
Piper Companies in Wayne, Pennsylvania💸 $120000 - $150000 per year -
Data Protection Platform Engineering Manager
Retail Business Services in Carlisle, Pennsylvania -
Senior Manager Data Engineering - Horsham, PA
UnitedHealth Group in Horsham, Pennsylvania -
Data Engineer Snaplogic
Veolia in Feasterville-Trevose, Pennsylvania -
Data Engineer
Piper Companies in Wayne, Pennsylvania💸 $120000 - $150000 per year -
Lead Data Engineer
Saxon Global in [horsham, Pa], Pennsylvania -
Knowledge Graph Engineer, Drug Discovery Data Engineering and Solutions
Johnson & Johnson in Spring House, Pennsylvania