Java Spark with AWS and Snowflake

Plano, Texas


Employer: Compunnel
Industry: 
Salary: Competitive
Job type: Part-Time

Location: Plano TX / Wilmington DE

Job Description:

Design, develop, and maintain scalable data pipelines using Apache Spark and Java.

Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

Optimize and tune data processing jobs for performance and cost-efficiency.

Ensure data quality, integrity, and security across all data pipelines and storage solutions.

Develop and maintain data models, schemas, and documentation.

Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.

Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. Snowflake

Experience with SQL and NoSQL databases.

CICd/ Jules /Spinnaker"

Education: Bachelors Degree

Created: 2024-09-21
Reference: GARDC5120003
Country: United States
State: Texas
City: Plano
ZIP: 75093