Java Spark with AWS and Snowflake
Plano, Texas
Employer: Compunnel
Industry:
Salary: Competitive
Job type: Part-Time
Location: Plano TX / Wilmington DE
Job Description:
Design, develop, and maintain scalable data pipelines using Apache Spark and Java.
Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune data processing jobs for performance and cost-efficiency.
Ensure data quality, integrity, and security across all data pipelines and storage solutions.
Develop and maintain data models, schemas, and documentation.
Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.
Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. Snowflake
Experience with SQL and NoSQL databases.
CICd/ Jules /Spinnaker"
Education: Bachelors Degree
Job Description:
Design, develop, and maintain scalable data pipelines using Apache Spark and Java.
Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune data processing jobs for performance and cost-efficiency.
Ensure data quality, integrity, and security across all data pipelines and storage solutions.
Develop and maintain data models, schemas, and documentation.
Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.
Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. Snowflake
Experience with SQL and NoSQL databases.
CICd/ Jules /Spinnaker"
Education: Bachelors Degree
Created: 2024-09-21
Reference: GARDC5120003
Country: United States
State: Texas
City: Plano
ZIP: 75093