Lead Data Engineer

[horsham, Pa], Pennsylvania


Employer: Saxon Global
Industry: 
Salary: Competitive
Job type: Part-Time

Client: United Health Group
Location: Horsham, PA (will need some occasional travel to client site; once or twice a quarter) - must live in Northeast/Mid-Atlantic areas.
Employment: Contract to Hire (Candidates must be interested in perm conversion around 6-9 months)
Status:Eligible consultants must be able to convert perm without sponsorship now or in the future."

Keys
  • Person with strong Python libraries (pandas, nmph)
  • Strong with PySpark/SparkQL - someone who has done Spark implementation in the past.
  • Create API's via Java, Python
  • Able to handle Kafka calls - MQ messages.
  • NoSQL - Hbase or MongoDB or similar
Role Summary:
This role will be responsible for transforming extensive and complex data into consumable business capabilities. Create system architecture, design, and specification using in-depth engineering skills and knowledge to solve complex development problems and achieve engineering goals. Determine and source appropriate data for a given analysis. Work with data modelers/analysts to understand the business problems they are trying to solve, then create or augment data assets to feed their analysis. Acts as a resource and mentor for colleagues with less experience.

Core Responsibilities:
  • Lead a team of data engineers to develop data products and tools, explore new technologies, and continually improve tools and processes.
  • Hands-on experience working with Data Analysis and Architecture, Spark, PySpark, Python, Sqoop, Pig, Hive, No SQL Data Stores, Object Store, Design and Development of APIs, Kafka
  • Create business value by leading the design, get your hands dirty, write code, and ultimately deploy big data and machine learning capabilities.
  • Possess expert knowledge in performance, large-scale data distributed system scalability, system architecture, and data engineering best practices.
  • Give the highest priority to operational excellence, evaluate system performance, security, design system metrics, and driving quality improvements.
  • Provide leadership, work collaboratively, and be a mentor in a fantastic team.
  • Your expertise is deep and broad; youre hands-on, producing both detailed technical work and high-level architectural designs.

Skills
  • Must have skills include Data Analysis and Architecture, Spark, PySpark, Python, Sqoop, Pig, Hive, No SQL Data Stores, Object Store, Design and Development of APIs, Kafka
  • 5+ years of recent hands-on in an object-oriented language (Java, Scala, Python).
  • 5+ years of experience designing and building data pipelines and data-intensive applications.
  • Experience using Big Data frameworks (e.g., Hadoop, Spark), databases for complex data assembly and transformation.
  • Experience working with Healthcare data is a plus.

Required Skills : Person with strong Python libraries (pandas, nmph) Strong with PySpark/SparkQL - someone who has done Spark implementation in the past. Create API's via Java, Python Able to handle Kafka calls - MQ messages. NoSQL - Hbase or MongoDB or similar
Basic Qualification :
Additional Skills :
Background Check :Yes
Notes :Location: Horsham, PA (will need some occasional travel to client site; once or twice a quarter) - must live in Northeast/Mid-Atlantic areas. Employment: Contract to Hire (Candidates must be interested in perm conversion around 6-9 months)
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :Yes
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship :Yes
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :Misc: Non-Technical
Branch Code :Minneapolis

Created: 2024-04-30
Reference: SG - 72375
Country: United States
State: Pennsylvania
City: [horsham, Pa]


Similar jobs: