SALARY

$84,999.2 - $154,999.52

POSITION SUMMARY

Under general supervision, takes a broader-scale focus to building, developing and maintaining data architectures, including back-end infrastructures, complex data integrations and associated processes. Participates in the design, evaluation, selection, implementation and support of new data engineering techniques related to processing data in both structured and unstructured formats. Makes use of a range of industry standard programming languages and data frameworks. Recommends ways to improve the reliability, quality and usefulness of agency data as it relates to the needs of enterprise Data Scientists, Analysts, related stakeholders and departmental direction.
PRIMARY RESPONSIBILITIES

• Develops, constructs, tests and maintains data architecture, including databases, data processing systems and related applications.
• Determines requirements that will be used to develop and evolve data models and algorithms.
• Develops custom applications and infrastructure as necessary.
• Uses advanced analytics methods to extract, transform, and load business data.
• Researches and deploys data infrastructure best practices. Builds and optimizes data pipelines to support cross-functional analytics, automation and programming needs.
• Develops and maintains best practices for marrying disparate CTA data systems. Liaises with Data Scientists, Programmers, Developers and Analysts to support integration of new data processing and warehousing technologies. Models complex business problems and discovers business insights through the use of statistical , algorithmic , mining, and visualization techniques
• Maintains existing data analytics infrastructure and architectures. Leads new efforts to acquire and centralize data from disparate systems. Works as directed to assist department Director in data related project oversight and execution.
• Researches best practices, recommends changes to improve efficiencies, assists in revising processes and procedures and establishes enterprise data architectures. Assesses existing business needs and anticipates future business needs in order to support the growth of department and agency infrastructure and applications.
• Hires, trains, develops, monitors and evaluates staff. Reviews and recommends personnel actions for approval.
• Performs other duties as assigned.

MANAGEMENT RESPONSIBILITIES

Reporting to this position are the following jobs:

Job Title

When under Performance Management:

• Analyst, Performance Management
• Senior Analyst, Performance Management
• Data Scientist

When under Strategic Business Initiatives:

• Senior Analyst, Data Analytics
• Programmer Analyst, Data Analytics
• Business Intelligence Developer

CHALLENGES

• Working with and managing massive amounts of data sourced from several disparate data systems and applications.
• Implementing effective time and project management processes to deliver data services on time and on budget.
• Balancing multiple high-priority requests simultaneously while adapting to rapidly-changing demands and meeting project deadlines.
• Providing consistency in data processing efforts to help shape the utilization and actionability of information.
• Rapidly acquiring new knowledge and skills
• Understanding business needs, producing results that have clear, positive, and direct impacts on business performance.

EDUCATION/EXPERIENCE REQUIREMENTS

• Bachelor's degree in Statistics, Computer Science, Mathematics, Operations Research, Industrial Engineering, Quantitative Analysis, Economics or a related field, plus four (4) years of experience in data engineering, development, and/or a combination of education and experience.
• Experience building and deploying predictive models, web scraping, and scalable data pipelines.

PHYSICAL REQUIREMENTS

• Requires sitting for extended periods of time, standing, visual acumen, manual dexterity and fingering for working with computer keyboards.
• Service Area Requirement: Exempt (Non-Union) employees must live within the boundaries of the CTA Statutory Service Area either at the time of employment or within 6 months of beginning employment at CTA.

KNOWLEDGE, SKILLS, AND ABILITIES

• Detailed knowledge of various data programming languages and frameworks (i.e. Python, SQL, Java, JavaScript, PHP, C#/.NET, VueJS, etc.).
• Detailed experience in custom and/or industry-standard data migration, integration, and ETL tools and techniques.
• Detailed knowledge of big data frameworks and tools (Hadoop, Spark, MongoDB, Cassandra, etc.)
• Detailed knowledge of programming development requirements and use of source/revision control systems (i.e. Git, Mercurial etc.)
• Strong knowledge of cloud-based data infrastructure (AWS, Azure, Google, Vertica)
• Strong knowledge of a range of RDBMS platforms (Postgres, Redshift, DynamoDB, Oracle, SQL Server, MySQL, DB2, etc.)
• Strong knowledge of specialized database architectures and computing environments.
• Strong knowledge of continuous delivery and deployment pipelines.
• Strong analytical, problem-solving, and decision-making skills.
• Strong report preparation and presenting skills.
• Strong oral and written communication skills to communicate recommendations to enable decision-making.
• Strong collaboration skills with cross-functional stakeholders to understand the business usage of data.
• Working knowledge of artificial intelligence (AI) and machine learning
• Strong interpersonal and team skills across a variety of fields and management levels.
• Strong project management skills.
• Strong organization and time management skills.
• Ability to effectively analyze and translate data engineering challenges to the business.
• Ability to manage large amounts of data and attention to detail.
• Ability to multitask competing projects and deadlines for completion.

WORKING CONDITIONS

• General office environment.
• Required to occasionally travel to locations throughout the CTA system and Chicago area as needed.

EQUIPMENT, TOOLS, AND MATERIALS UTILIZED

• Standard office equipment.
• Modern data engineering tools, platforms and processes.