Senior Data Engineer with Azure and Scala

Raleigh, New Jersey


Employer: UBS
Industry: Information Technology (IT)
Salary: Competitive
Job type: Full-Time

Your role

Do you like building complex, secure platforms with a touch of a button? Are passionate about developing automated infrastructure as code that is successfully rolled out across a global implementation? Do you have what it takes to build robust solution that aide data engineers in delivering their data pipelines? Do you thrive in a multi team environment where different team contributes towards microservices that form a data platform?

We are looking for a hands-on Data Engineer in the Group Compliance & Regulatory Governance (GCRG) Technology team to:

• engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using Azure cloud data platform infrastructure effectively
• transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques
• develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems
• ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements
• build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues
• problem solving and analytical skills and ability to clearly communicate and articulate complex solutions
• codify best practices, methodology and share knowledge with other engineers in UBS

Your team

You will be working as part of the Group Compliance Regulatory Governance Technology stream that focuses on Data Analytics and Reporting. Our crew is using the latest data platforms to further the group's data strategy to realize the true potential of data as an asset through utilizing data lakes, data virtualization, for use with advanced analytics, AI/ML. The crew also ensure the data is managed with strategic sourcing and data quality tooling. Your team will be responsible for building the central GCRG data lake, developing data pipelines to strategically source data from master and authoritative source, creating data virtualization layer, building connectivity for advanced analytics and elastic search capabilities with the aid of cloud computing.

Diversity helps us grow, together. That's why we are committed to fostering and advancing diversity, equity, and inclusion. It strengthens our business and brings value to our clients.

Your expertise

• Bachelor or Master's degree in Computer Science or any similar engineering is highly desired
• ideally 5+ years of total IT experience in SWD or engineering
• ideally 3+ years of hand-on experience designing and building scalable data pipelines for large datasets on cloud data platforms
• ideally 3+ years of hand-on experience in distributed processing using Databricks, Apache Spark, Kafka & leveraging Airflow scheduler/executor framework
• ideally 2+ years of hand-on experience programming experience in Scala (must have), Python & Java (preferred)

Additional Hands-on Experience in the following:
• Experience with monitoring solutions such as Azure Logs, AppInsights, Graphana to optimize spark jobs
• knowledge in Azure capable languages, such as ARM, Terraform, Ansible, PowerShell, YAML and understanding of Azure API's is a plus
• proficiency at working with large and complex code bases (Github, Gitflow, push/Pull Model) and development tools like IntelliJ
• experience working with Agile development methodologies and delivering with Azure DevOps, automated testing on tools used to support CI and release management
• expert in creating data structures optimized for storage and various query patterns for e.g., Parquet and Delta Lake. Ability to work across disparate datasets, identifying, extracting, and linking information

About us

UBS is the world's largest and the only truly global wealth manager. We operate through four business divisions: Global Wealth Management, Personal & Corporate Banking, Asset Management and the Investment Bank. Our global reach and the breadth of our expertise set us apart from our competitors..

We have a presence in all major financial centers in more than 50 countries.

Join us

At UBS, we embrace flexible ways of working when the role permits. We offer different working arrangements like part-time, job-sharing and hybrid (office and home) working. Our purpose-led culture and global infrastructure help us connect, collaborate, and work together in agile ways to meet all our business needs.

From gaining new experiences in different roles to acquiring fresh knowledge and skills, we know that great work is never done alone. We know that it's our people, with their unique backgrounds, skills, experience levels and interests, who drive our ongoing success. Together we're more than ourselves. Ready to be part of #teamUBS and make an impact?

Disclaimer / Policy Statements

UBS is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills and experiences within our workforce.

Created: 2024-05-04
Reference: 295097BR
Country: United States
State: New Jersey
City: Raleigh