Trade Floor Data Engineer
Houston, Texas
Employer: Saxon Global
Industry:
Salary: Competitive
Job type: Part-Time
Job Description:
Responsibilities
•The purpose of this job is to provide technical expertise for research, development and modification of data engineering processes and jobs in support of a Big Data infrastructure for PFJ Energy in the commodities and energy space
•Research, develop, document, and modify Data Engineering processes and jobs per data architecture and modeling requirements;
•Collaborate with Data Analytics team members such as Data Strategists and Data Scientists
•Collaborate with business stakeholders to understand data needs, including data velocity, veracity, and access patterns
•Provide technical expertise to implement Data and Analytics specifications
•Serve on cross-functional project teams and provide perspective for the Data Analytics team on executing key deliverables
•Troubleshoot complex, escalated issues, including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs)
•Proactively maintain and tune all code according to internally documented Data Engineering standards and best practices
•Review and ensure appropriate documentation for all new development and modifications of the Data Lake processes and jobs
•Perform code and process reviews and oversee testing for solutions developed, and ensure integrity and security of institutional data
•Educate business stakeholders on the usage and benefits of the data Lake / Lakehouse and related technologies
•Mentor and guide less experienced team members and provide feedback on project work
•Ensure all activities are in compliance with rules, regulations, policies, and procedures
•Complete other duties as assigned
Qualifications
•Bachelor's degree in computer science, engineering, information technology, or related field, required
•Minimum eight years of technology operations experience required
•Experience in the commodities and energy space is required
•Strong knowledge of Relational Databases like Oracle, Postgres or SQL Server required
•Experience with Apache Spark or Spark-streaming, Message Queue technologies and Python required
•Strong knowledge of enterprise data warehouse (EDW) data models with a focus on Star Schema data modeling techniques required
Must Haves:
Trading floor/commodities experience Willing to work onsite at our Houston office 5 days a week from 8-5 Knowledge of: Tableau, SQL, Databricks, AWS, Snowflake, Big Data Principles
Nice to Have:
Right Angle Worked in scrum framework
Required Skills : Trade Floor/commodities experience Experience with Tableau, SQL, Data bricks, AWS, Snowflake Big Data Principles
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :No
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :Yes
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :Development/Engineering
Master Job Title :Big Data: Other
Branch Code :Nashville
Responsibilities
•The purpose of this job is to provide technical expertise for research, development and modification of data engineering processes and jobs in support of a Big Data infrastructure for PFJ Energy in the commodities and energy space
•Research, develop, document, and modify Data Engineering processes and jobs per data architecture and modeling requirements;
•Collaborate with Data Analytics team members such as Data Strategists and Data Scientists
•Collaborate with business stakeholders to understand data needs, including data velocity, veracity, and access patterns
•Provide technical expertise to implement Data and Analytics specifications
•Serve on cross-functional project teams and provide perspective for the Data Analytics team on executing key deliverables
•Troubleshoot complex, escalated issues, including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs)
•Proactively maintain and tune all code according to internally documented Data Engineering standards and best practices
•Review and ensure appropriate documentation for all new development and modifications of the Data Lake processes and jobs
•Perform code and process reviews and oversee testing for solutions developed, and ensure integrity and security of institutional data
•Educate business stakeholders on the usage and benefits of the data Lake / Lakehouse and related technologies
•Mentor and guide less experienced team members and provide feedback on project work
•Ensure all activities are in compliance with rules, regulations, policies, and procedures
•Complete other duties as assigned
Qualifications
•Bachelor's degree in computer science, engineering, information technology, or related field, required
•Minimum eight years of technology operations experience required
•Experience in the commodities and energy space is required
•Strong knowledge of Relational Databases like Oracle, Postgres or SQL Server required
•Experience with Apache Spark or Spark-streaming, Message Queue technologies and Python required
•Strong knowledge of enterprise data warehouse (EDW) data models with a focus on Star Schema data modeling techniques required
Must Haves:
Nice to Have:
Required Skills : Trade Floor/commodities experience Experience with Tableau, SQL, Data bricks, AWS, Snowflake Big Data Principles
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :No
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :Yes
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :Development/Engineering
Master Job Title :Big Data: Other
Branch Code :Nashville
Created: 2024-05-25
Reference: SG - 75104
Country: United States
State: Texas
City: Houston
ZIP: 77069
Similar jobs:
-
Senior Data Engineer
Improving Enterprises, Inc. in Dallas, Texas -
Systems Engineer II-Backend Data Engineer
University of Texas at Dallas in Dallas, Texas💸 $80000 - $87000 per year -
Lead Computer Engineer, AST, Data Systems
Lyndon B. Johnson Space Center in Houston, Texas -
Data Engineer II, Global Procurement Program (GPP)
Amazon in Austin, Texas -
Data Factory Engineer
Insight Global in Austin, Texas💸 $70 - $75 per hour -
Analyst, Senior Data Engineering
Enterprise Products in Houston, Texas -
Data Engineer
Addison Group in Houston, Texas -
Senior Data Engineer
eSmartloan in Plano, Texas -
Senior Manager Data Network Architecture and Engineering Job Details | Entergy
Entergy Corp. in The Woodlands, Texas -
Platform Architect, Enterprise Data Engineering
Insperity in Kingwood, Texas💸 $108800 - $160500. per year -
Data Scientist (Big Data Engineer) 3
Esolvit, Inc. in Austin, Texas -
Data Governance Engineer (Monte Carlo)
INSPYR Solutions in Fort Worth, Texas -
Data Analyst - Machine Learning Engineer
Capgemini in Dallas, Texas -
Sr. Software Engineer, Tools and Framework (Data) - Ad Platforms
Apple in Austin, Texas -
Director, Technical Program Management- Platform Data Engineering (Remote Eligible)
eSmartloan in Plano, Texas -
Data Center Cable Infrastructure Engineer , DCC Communities, DCC Communities
Amazon in Garland, Texas -
Business Intelligence Engineer, Big Data Platform, Pharmacy Analytics Platform
Amazon in Austin, Texas💸 $79600 per year -
Engineering Project Manager, Ai & Data Platforms
Apple in Austin, Texas -
GCP Data Engineer
Insight Global in Irving, Texas -
Senior Data Engineer
eSmartloan in Plano, Texas