Data Engineer II
Austin, Texas
Employer: INTELLISWIFT INC
Industry: Customer Job
Salary: $55 per hour
Job type: Full-Time
Job ID: 24-05160 Pay rate range - $55/hr. to $57/hr. on W
Austin TX - Hybrid 3 days in office
Must Have
AWS Cloud services
Data Engineering
Python or Scala
REQUIRED SKILLS
Years of Experience: 3 - 5+ years of experience
Degree or Certification:
BASIC QUALIFICATIONS
PREFERRED QUALIFICATIONS
Austin TX - Hybrid 3 days in office
Must Have
AWS Cloud services
Data Engineering
Python or Scala
REQUIRED SKILLS
- Looking for Sr. Data engineer
- Very comfortable with Data modeling, data warehousing ETL, and Scripting. Orchestration, Data Pipeline, Taxonomy
- Python, Scala or Spark, SQL
- Looking for someone who is already AWS cloud services like S3, lambda, glue, EMR, Lake formation, step function, ec2
- Experience with AWS services with a minimum 2 years is a Must
Years of Experience: 3 - 5+ years of experience
Degree or Certification:
- BS in Computer science or Statistics or engineering
- Masters Preferred
- Data Engineer Certification
- AWS certification
- As a Data Engineer, your pivotal role will revolve around designing, building, and maintaining robust data pipelines and infrastructure to drive data-driven insights.
- Core responsibilities include architecting scalable and fault-tolerant pipelines to extract, transform, and load data from various sources into data warehouses or lakes.
- Leveraging cutting-edge tools and technologies, you'll implement ingestion, transformation, and integration processes, ensuring stringent data quality through validation, cleansing, and deduplication.
- You'll design and implement high-performance, scalable, and cost-efficient data storage solutions. Utilizing CI/CD principles, you'll automate infrastructure deployment and maintenance processes, ensuring a streamlined data ecosystem.
- Data modeling and engineering will be crucial, involving designing and implementing optimized data models, developing and maintaining ETL processes, and collaborating with analysts and functional managers to understand data needs and provide tailored data structures.
- Ensuring data governance, security, and compliance will be paramount.
- You'll implement robust policies and processes, enforce access controls, encryption, and auditing mechanisms, and collaborate cross-functionally to establish and maintain data governance standards.
- Continuous improvement and automation will be woven into your daily activities, continuously evaluating and optimizing processes, pipelines, and infrastructure, implementing automation and monitoring tools, and staying ahead of emerging data engineering technologies and trends.
BASIC QUALIFICATIONS
- 3+ years of data engineering experience with data modeling, warehousing, and building ETL pipelines
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence Knowledge of distributed systems as it pertain to data storage and computing
- Experience with SQL
- A good candidate can partner with business owners directly to understand their requirements and provide data that can help them observe patterns and spot anomalies.
- Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT, or equivalent
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM roles and permissions
- Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases, column-family databases)
- Master's degree in computer science, engineering, analytics, mathematics, statistics, IT, or equivalent
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Experience building world-class data environments with a high emphasis on data quality and data security
- Strong problem-solving and analytical skills, with the ability to translate business requirements into technical solutions
Created: 2024-09-26
Reference: q3wlgE3ZQSCV
Country: United States
State: Texas
City: Austin
ZIP: 78749
Similar jobs:
-
Sr. Data/ ML Ops Engineer
Insight Global in Irving, Texas💸 $55 per hour -
Data Engineer
Addison Group in Houston, Texas -
Platform Architect, Enterprise Data Engineering
Insperity in Kingwood, Texas💸 $108800 - $160500. per year -
Software Engineer (Data), Ai & Data Platforms
Apple in Austin, Texas -
Sr. Data Engineer
Insight Global in Irving, Texas💸 $50 per hour -
Software Engineer (UI - Solutions), Ai & Data Platforms
Apple in Austin, Texas -
Data Engineer II, AWS Actuals
Amazon in Dallas, Texas💸 $118900 per year -
REMOTE Data Engineer
Insight Global in Dallas, Texas -
Data Scientist, Sales Insights, Analytics, Data Engineering \u0026 Science (SIADS), Sales Insights, Analytics, Data Engineering \u0026 Science (SIADS)
Amazon in Austin, Texas💸 $125500 per year -
Software Engineer, IS&T Ai & Data Platforms
Apple in Austin, Texas -
Data Engineer
Vulcan Materials Company in Euless, Texas -
Product Manager, Enterprise Data Engineering
Insperity in Kingwood, Texas💸 $108800 - $137200. per year -
Data Engineer
Insight Global in Coppell, Texas -
Data Engineer, Program Analytics
Apple in Austin, Texas -
Big Data Engineer Architect
SAIC in Remote Work, Texas💸 $120001 - $160000. per year -
BI Data Engineering Manager
McLane Company, Inc. in Temple, Texas -
Software Development Engineer, SMGS Data Platform Team
Amazon in Dallas, Texas💸 $129300 per year -
Azure and Databricks Data Engineer
Infosys Limited Digital in Richardson, Texas -
Data Engineer, Woot!
Amazon in Carrollton, Texas -
Contextualization Data Engineer - INTL Hyderabad India
Insight Global in Irving, Texas