Software Engineer, ML System Scheduling

Seattle, Washington


Employer: TikTok
Industry: R&D
Salary: Competitive
Job type: Full-Time

Responsibilities

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

Team Intro
AML (Applied Machine Learning) Machine Learning System team focuses on the research and implementation of cutting-edge technologies in the field of Machine Learning systems, providing high-performance, highly reliable, scalable systems.
In the team, you'll have the opportunity to build the large scale heterogeneous system integrating with GPU/RDMA/Storage and keep it running stable and reliable, enrich your expertise in coding, performance improvement and problem analysis,and be involved in the decision-making process.

Responsibilities:
1. Responsible for the design and development of resource scheduling, including model training, model evaluation and model inference in various scenarios (LLM/AIGC/NLP/CV/Speech, etc.)
2. Responsible for the optimal orchestration of various computing resources (GPU, CPU, other heterogeneous hardware), realizing the rational use of stable resources, tidal resources, mixed resources, and multi-cloud resources
3. Responsible for the optimal combination of computing resources, RDMA high-speed network resources, and storage resources, and giving full play to the power of large-scale distributed clusters
4. Responsible for offline and online workload scheduling in global data centers integrating multi-cloud scenarios to achieve rational distributions

Qualifications

Minimum Qualifications:
1. Be proficient in 1 to 2 programming languages such as Go/Python/Shell in Linux environment
2. Be familiar with Kubernetes architecture and container technology such as Docker/Containerd/Kata/Podman, and have rich experience in Machine Learning system practice and development
3. Understand the principles of distributed systems and have experience in the design, development and maintenance of large-scale distributed systems
4. Have an excellent logical analysis ability, able to reasonably abstract and split business logic
5. Have a strong sense of responsibility, good learning ability, communication skills and self-drive, able to respond and act quickly

Preferred Qualifications
1. Familiar with at least one major Machine Learning framework (TensorFlow/PyTorch)
2. Experience in one of the following fields: AI Infrastructure, HW/SW Co-Design, High Performance Computing, ML Hardware Architecture (GPU, Accelerators, Networking)

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at rd.accommodations@tiktok.com

Created: 2024-06-21
Reference: A140904
Country: United States
State: Washington
City: Seattle
ZIP: 98109


Similar jobs: