Senior Software Engineer - Hadoop Infrastructure
New York, New York
Employer: Bloomberg LP
Industry: Engineering
Salary: Competitive
Job type: Full-Time
The Team
Bloomberg runs on data! It's our business and our product. Financial institutions need timely, accurate data to capture opportunities and evaluate risk in fast-moving markets, from the biggest banks to elite hedge funds.
Bloomberg's application teams face complex challenges - large-scale data storage, low-latency retrievals, high-volume requests, and high availability over a distributed computing and storage environment. Hadoop Infrastructure's mission is to provide a multi-tenant, observable, and highly available infrastructure backed by the open-source Apache Hadoop platform (HDFS, HBase, Hive, Oozie, YARN/Spark, etc.) to support large-scale data applications across Bloomberg. The Hadoop Infrastructure team manages clusters that handle 10s of PB of storage spread across 1000s of servers running 100s of billions of requests per day and running 10s of thousands of jobs hitting 100s of thousands of tables every day. We also provide standard methodologies and domain expertise on Hadoop services to applications across various product domains at Bloomberg.
Who are you?
Bloomberg is an equal opportunity employer, and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg provides reasonable adjustment/accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable adjustment/accommodation to apply for a job or to perform your job. Examples of reasonable adjustment/accommodation include but are not limited to making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment. If you would prefer to discuss this confidentially, please email AMER_recruit@bloomberg.net (Americas), EMEA_recruit@bloomberg.net (Europe, the Middle East and Africa), or APAC_recruit@bloomberg.net (Asia-Pacific), based on the region you are submitting an application for.
Bloomberg runs on data! It's our business and our product. Financial institutions need timely, accurate data to capture opportunities and evaluate risk in fast-moving markets, from the biggest banks to elite hedge funds.
Bloomberg's application teams face complex challenges - large-scale data storage, low-latency retrievals, high-volume requests, and high availability over a distributed computing and storage environment. Hadoop Infrastructure's mission is to provide a multi-tenant, observable, and highly available infrastructure backed by the open-source Apache Hadoop platform (HDFS, HBase, Hive, Oozie, YARN/Spark, etc.) to support large-scale data applications across Bloomberg. The Hadoop Infrastructure team manages clusters that handle 10s of PB of storage spread across 1000s of servers running 100s of billions of requests per day and running 10s of thousands of jobs hitting 100s of thousands of tables every day. We also provide standard methodologies and domain expertise on Hadoop services to applications across various product domains at Bloomberg.
Who are you?
- You are a dedicated and motivated engineer interested in building and managing large-scale distributed systems, looking for a tight-knit, collaborative team.
- You are an innovative problem solver who enjoys working in multiple roles and thrives in a fast-paced environment.
- You want to make a significant impact and contribute to open-source software.
- Advance how tenants from multiple product domains leverage Hadoop Infrastructure services to meet their goals
- Provide and improve our capabilities to migrate and support a massive data and compute footprint (10s of PB) to newer versions.
- Improve our tenants' user experience when securely interacting with powerful underlying infrastructure frameworks.
- Understand and improve the usability, reliability, and scalability of open-source Apache Hadoop services to optimize for the needs of Bloomberg application teams.
- 4+ years of demonstrated experience working with an object-oriented programming language (Java) and associated technologies (eg. Spring/JMX/JDBC)
- A degree in Computer Science, Engineering or similar field of study or equivalent work experience.
- 3+ years of experience in the Hadoop ecosystem and related technologies (HBase, Hive 3, HDFS, Spark, Oozie)
- Knowledge of modern development methodologies and tools (Jenkins/Maven/Jira).
- Solid understanding of Linux Operating system, Shell scripting, OS troubleshooting
- Strong problem-solving and communication skills.
- Experience with distributed systems architecture and system design.
- Knowledge of Ansible.
- Experience working with open-source software/community.
Bloomberg is an equal opportunity employer, and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg provides reasonable adjustment/accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable adjustment/accommodation to apply for a job or to perform your job. Examples of reasonable adjustment/accommodation include but are not limited to making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment. If you would prefer to discuss this confidentially, please email AMER_recruit@bloomberg.net (Americas), EMEA_recruit@bloomberg.net (Europe, the Middle East and Africa), or APAC_recruit@bloomberg.net (Asia-Pacific), based on the region you are submitting an application for.
Created: 2024-06-30
Reference: 117282
Country: United States
State: New York
City: New York
ZIP: 10036
Similar jobs:
-
Senior Software Engineer, Back End
eSmartloan in New York, New York💸 $165100 - $188500 per year -
Software Engineer, Systems
Meta in New York, New York -
Software Engineer
Meta in New York, New York -
Lead Software Engineer - Salesforce Mulesoft Lead Developer
Northwell Health in Lake Success, New York💸 $130300 - $228000 per year -
Senior Software Development Engineer, SDKs Release Platform | AWS SDKs and Tools
Amazon in New York, New York💸 $151300 per year -
Software Engineer, Gameplay - Reality Labs
Meta in New York, New York -
Manager, Software Engineering, Back End
eSmartloan in New York, New York -
Senior Software Engineer, Machine Learning, Geo
Google in New York, New York -
Software Development Engineer, Fraud Reduction Enforcement Systems and Controls in Advertising (FRESCA)
Amazon in New York, New York💸 $129300 per year -
Sr Software Engineer, Amazon Marketing Cloud
Amazon in New York, New York💸 $151300 per year -
Lead Software Engineer (Python/NodeJS/AWS)
Phyton Talent Advisors in Edgewood, New York -
Software Engineer
Meta in New York, New York -
Software Engineer, Product
Meta in New York, New York -
Senior Director, Software Engineering
AEG in New York, New York -
Senior Software Development Engineer - AWS SDK for C++/Common Runtime Tools, DX - SDK \u0026 Tools
Amazon in New York, New York💸 $151300 per year -
Evidence Lab Data & Analytics Software Engineer
UBS in New York, New York -
CI Sr Software Engineer
USI Holdings Corporation in Valhalla, New York -
Software Development Engineer - Machine Learning, Amazon Advertising - Sponsored Products
Amazon in New York, New York💸 $129300 per year -
Software Engineer
Meta in New York, New York -
Lead Software Engineer - Ensemble Developer
Northwell Health in Melville, New York💸 $121200 - $212100 per year