Data Engineer
New York, New York
Employer: Phyton Talent Advisors
Industry: Data Analyst
Salary: Competitive
Job type: Full-Time
Data Engineer - Major Law Firm (NYC or LA)
The Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder who enjoys optimizing data systems and building them from the ground up. This individual will support our software developers, architects, and data owners across various data initiatives and ensures an optimal and consistent data delivery architecture. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
ESSENTIAL FUNCTIONS
PROFICIENCIES
Demonstrates knowledge of the following processes, tools or applications:
QUALIFICATIONS
The Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder who enjoys optimizing data systems and building them from the ground up. This individual will support our software developers, architects, and data owners across various data initiatives and ensures an optimal and consistent data delivery architecture. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
ESSENTIAL FUNCTIONS
- Design, construct, test and maintain data architectures and data pipelines
- Ensure our data architecture supports the requirements of the business
- Develop custom data models and algorithms to apply to data sets
- Assess the effectiveness and accuracy of new data sources and data gathering techniques. Discover opportunities for data acquisition
- Develop data set processes for data modeling, mining and production
- Employ a variety of languages and tools to marry systems together
- Recommend ways to improve data reliability, efficiency and quality
- Leverage large volumes of data from internal and external sources to answer business demands
- Introduce automation through effective metadata management and using innovative and modern tools and techniques. Partially or completely automate the most common and repeatable data preparation and integration tasks
- Propose appropriate data ingestion, preparation, integration and operationalization techniques in addressing data requirements
- Lead the development of data governance policies and best practices for consumers and users of data we provision.
- Coordinate with different functional teams to implement models and monitor outcomes
- Develop processes and tools to monitor and analyze model performance and data accuracy
PROFICIENCIES
Demonstrates knowledge of the following processes, tools or applications:
- Experienced in designing, building and managing data pipelines for data structures.
- Expertise with advanced analytics tools for Object-oriented/object function scripting. Includes languages such as C#, Python and others.
- Expert in SQL, PL/SQL, SSIS and SSAS
- Knowledge and/or certifications on upcoming NoSQL/Hadoop-oriented databases like MongoDB, Cassandra, and others for non-relational databases
- Experienced working with large, heterogeneous data sets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies.
- Experienced working with popular data discovery, analytics and BI software tools such as Tableau, Power BI and others
- Experienced working with data governance/data quality and data security teams
- Experienced employing Microsoft MDM (Master Data Management) and MDS
- Ability to troubleshoot complicated issues across multiple systems and driving solutions.
- Effectively convey technical concepts to non-technical individuals
- Demonstrate a high level of Data Security Awareness
- Experience with financial and legal industry data is a plus
QUALIFICATIONS
- A bachelor's or master's degree in computer science, statistics, applied mathematics, data management, information systems, information science or a related quantitative field or equivalent work experience
- At least five years' experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks
- At least three years' experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental and/or multi-departmental data management and analytics initiative
- Excellent communication and collaboration skills
- Excellent problem solving and analytical skills.
- Must be highly effective within a collaborative environment.
- Must be able to independently resolve issues and efficiently self-direct work activities based on the ability to capture, organize, and analyze information
Created: 2024-04-23
Reference: 50263
Country: United States
State: New York
City: New York
ZIP: 10036
Similar jobs:
-
Sr Data Engineer, Creators
Amazon in New York, New York💸 $123700 per year -
UK Onsite Senior Data Engineer
Insight Global in New York, New York -
Evidence Lab Data & Analytics Software Engineer
UBS in New York, New York -
Data Engineer
American Express in New York, New York -
Data Engineer
Meta in New York, New York -
Data Engineer, Global Payments - USDS
TikTok in New York, New York -
Data Support Engineer
Delaware North in Buffalo, New York💸 $66500 - $89900 per year -
Engineering Team Lead - Data Platform - Artificial Intelligence
Bloomberg LP in New York, New York -
Data Engineer
Open Systems Technologies in New York City, New York💸 $115000 - $160000 per year -
Senior Quality Engineer - JavaScript - Agile - U.S. Consumer Services and Enterprise Digital & Data Technology
American Express in New York, New York💸 $110000.00 per year -
Data Engineer
Meta in New York, New York -
Data Engineer, GMS
Meta in New York, New York -
Senior Machine Learning Engineer - Data Curation - AIGC, TikTok Monetization GenAI
TikTok in New York, New York -
Data Defense Solutions Engineer
TikTok in New York, New York -
Senior Engineer - Java - Enterprise Data Management
American Express in New York, New York💸 $110000.00 per year -
Data Engineer I
INTELLISWIFT INC in New York, New York💸 $50 per hour -
Data Engineer
Open Systems Technologies in New York, New York💸 $70 - $100 per hour -
Senior Data Management Professional - Data Engineering - Company Financials BI
Bloomberg LP in New York, New York -
Data Engineer Levels 1-3
Metropolitan Transportation Authority in New York, New York💸 $67172 - $88163 per year -
Sr. Data Engineer, Amazon Shopping Videos
Amazon in New York, New York💸 $123700 per year