Cloud Data Platform Engineer
New York, New York
Employer: Global Channel Management, Inc.
Industry:
Salary: Competitive
Job type: Full-Time
Job Description:
Cloud Data Platform Engineer needs 5+ years' implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
5+ year support experience of Big Cloud Data Platform Engineer requires:
Preferred Skills:
Cloud Data Platform Engineer duties:
Company Description:
Global Channel Management is a technology company that specializes in various types of recruiting and staff augmentation. Our account managers and recruiters have over a decade of experience in various verticals. GCM understands the challenges companies face when it comes to the skills and experience needed to fill the void of the day to day function. Organizations need to reduce training and labor costs but at same requiring the best "talent " for the job
https://www.globalchannelmanagement.com/
Cloud Data Platform Engineer needs 5+ years' implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
5+ year support experience of Big Cloud Data Platform Engineer requires:
- 3 days a week, hybrid
- Locations: Iselin, NJ, Charlotte, NC, N Y, NY
- Data Engineering 60-70 %.
- Infrastructure 30-40%. (Moving Data in & Out of cloud)
- Snowflake exp is preferred
- Master's or Bachelor's degree in computer science or related discipline
- Manage and ensure delivery of project tasks as required
- Excellent documentation skills to create and manage design, implementation and automation related documentation
- Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.
- Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.
- Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.
- Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.
- Must be ability to multi-task and prioritize tasks for self
- Must experience working in agile environment with multiple priorities
Preferred Skills:
- 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
- 5+ year support experience of Big Data technologies in Hadoop ecosystem - Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.
- 5+ years' experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.
- 5+ years' experience with Orchestration tools such as Airflow, Autosys etc.
- Experience with Jira and Agile methodology is a plus;
- Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities
Cloud Data Platform Engineer duties:
- Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems
- Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.
- Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.
- Identifies and documents all system constraints, implications, and consequences of various proposed system changes.
- Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
- Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform.
Company Description:
Global Channel Management is a technology company that specializes in various types of recruiting and staff augmentation. Our account managers and recruiters have over a decade of experience in various verticals. GCM understands the challenges companies face when it comes to the skills and experience needed to fill the void of the day to day function. Organizations need to reduce training and labor costs but at same requiring the best "talent " for the job
https://www.globalchannelmanagement.com/
Created: 2024-04-16
Reference: 392404
Country: United States
State: New York
City: New York
ZIP: 10036
Similar jobs:
-
Senior Software Development Engineer, SDKs Release Platform | AWS SDKs and Tools
Amazon in New York, New York💸 $134500 per year -
Lead Cloud Platform Engineer (Multi Cloud Kubernetes)
Morgan Stanley in New York, New York💸 $140000 - $200000 per year -
Engineering Team Lead - Data Platform - Artificial Intelligence
Bloomberg LP in New York, New York -
Lead Software Engineer - Cloud Platform
Northwell Health in Melville, New York💸 $121200 - $212100 per year -
Frontend Engineer, AWS Commerce Platform
Amazon in New York, New York💸 $115000 per year -
Platform Engineer
Apple in New York City, New York -
Software Engineer, SRE - Platform Services - USDS (NYC)
TikTok in New York, New York -
staff platform solutions engineer
King in New York, New York💸 $111780.00 per year -
Specialist Software Platform Engineer
Metropolitan Transportation Authority in New York, New York💸 $110748 - $130719 per year -
Senior ML Platform Engineer - Artificial Intelligence Group
Bloomberg LP in New York, New York -
Senior Software Engineer, Customer Data Platform (Mailchimp)
Intuit in New York, New York -
Senior Staff Engineer - Delivery Platform
Uber in New York, New York💸 $218000 per year -
Senior Associate, Cloud Platform Engineer
KPMG in Albany, New York💸 $76500 - $149900 per year -
Site Reliability Engineer, Data Platform- USDS
TikTok in New York, New York -
Tech Lead Software Engineer - AIGC Platform, TikTok Monetization GenAI
TikTok in New York, New York -
Software Development Engineer, AWS Commerce Platform
Amazon in New York, New York💸 $115000 per year -
Software Development Engineer, AWS Commerce Platform
Amazon in New York, New York💸 $115000 per year -
Principal Engineer, Google Production Platform Solutions
Google in New York, New York -
Google Platform Cloud Engineer
Morgan Stanley in New York, New York💸 $140000 - $200000 per year -
Site Reliability Engineer - Video Platform - USDS (NYC)
TikTok in New York, New York