Production Systems Engineer, Fleet AI Systems (NetZero)

Menlo Park, California


Employer: Meta
Industry: 
Salary: Competitive
Job type: Full-Time

Meta is seeking a Production Systems Engineer to join our Release to Production (RTP) team. Our servers and data centers are the foundation upon which our rapidly scaling infrastructure operates efficiently to deliver our innovative services. The RTP team is responsible for the Hardware Lifecycle of all Meta servers including pre-production hands-on system and hardware debugging and stress testing, enabling production-ready system monitoring, automated provisioning and automated remediation of issues. RTP Engineers work closely with hardware designers, system manufacturers, component vendors, capacity engineering, production engineering, Facebook services, and data center operations teams to test systems before release to our production data centers, and to track the health and lifecycle of servers in production.

Production Systems Engineer, Fleet AI Systems (NetZero) Responsibilities


  • Interface with external vendors and internal hardware, mechanical, power, thermal, manufacturing and software engineers to understand system architecture to develop and execute the test suites for various architectures

  • Proactively create experiments and tooling to detect and diagnose hardware/firmware/software health issues

  • Develop test framework for large-scale test automation inside fleet during product development and after mass production

  • Implement remediations across software and hardware stack according to plan, while keeping a thorough procedural record and data log

  • Develop and publish updates on resolutions and communicate findings internally. Troubleshoot, diagnose and root cause of system failures and isolate the components/failure scenarios while working with internal & external stakeholders

  • Develop visibility through data visualization and implement systemic solutions to hardware health issues

  • Drive necessary discussion with external and internal teams on test specification and methodologies to improve test quality continuously

  • Contribute to Meta's 2030 Net Zero targets by evaluating sustainability, carbon footprint of new hardware design and infrastructure design. Partner with Net Zero teams to implement strategies across infrastructure for reuse, recycling, energy aware computing and quality practices for deployed and decommissioned hardware


Minimum Qualifications


  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

  • 4+ years of experience in hardware system support, knowledge of server architecture and components

  • Experience with Energy Aware Computing and/or Sustainable Infrastructure Design

  • Experience with Linux and scripting. Experience in changing system configurations and measuring change impact

  • Experience working in a matrix organization. Engineering for different server system/data center products


Preferred Qualifications


  • 4+ years experience in Production support at scale

  • 4+ years experience in full system technologies, full system lifecycle

  • Experience supporting AI/HPC systems and/or related components at scale. Experience in post-production hyperscale post-production environments, solutions


Start preparing
Learn about how to prepare for your interview with our interview guide, tips, and interactive experiences.
Visit interview prep

Created: 2024-08-30
Reference: 1171973390793305
Country: United States
State: California
City: Menlo Park


Similar jobs: