Product Manager, LLM Data Acquisition and Production
San Jose, California
Employer: TikTok
Industry: Product
Salary: Competitive
Job type: Full-Time
Responsibilities
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.
Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.
About The Team:
LLM Global Data is a team focused on producing international data for LLMs. For the training of large models, data is the lifeline of model quality - and the Global Data team is working closely with technical, product, and operations teams to ensure effective data production strategies and execution management. There's a lot to do, and there's substantial room for impact, similar to TikTok 5 years ago.
The primary job responsibilities include:
1. Collaborate with technical teams to precisely define the data requirements necessary for aligning Large Language Models (LLMs) across global markets.
2. Develop methodologies for data acquisition and production, while also monitoring costs and assessing the effectiveness and efficiency of these processes. Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback.
3. Evaluate the impact of data production tools on the effectiveness and quality of data production. Work closely with technical teams to enhance both the quality and effectiveness of these tools.
4. Proactively identify and mitigate potential biases and vulnerabilities in the data production process. This includes, but is not limited to, addressing human and system biases through the implementation of technical, product, and operational solutions.
Qualifications
1. Solid understanding of alignment and related approaches, such as Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and others. Or solid experience in moderation, labeling, search quality, or data synthesis.
2. Minimum of three years of experience as a product manager or product strategist, including process design experience.
3. A strong interest in both LLMs and human behavior/experience/wellbeing. Must be an enthusiastic learner. This position is not suitable for individuals who find reading papers and books to be tedious.
4. Collaborative team player who knows how to assertively advocate for their ideas without being overbearing. Skilled in maintaining attention to detail while staying focused on prioritized goals and the bigger picture.
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at rd.accommodations@tiktok.com.
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.
Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.
About The Team:
LLM Global Data is a team focused on producing international data for LLMs. For the training of large models, data is the lifeline of model quality - and the Global Data team is working closely with technical, product, and operations teams to ensure effective data production strategies and execution management. There's a lot to do, and there's substantial room for impact, similar to TikTok 5 years ago.
The primary job responsibilities include:
1. Collaborate with technical teams to precisely define the data requirements necessary for aligning Large Language Models (LLMs) across global markets.
2. Develop methodologies for data acquisition and production, while also monitoring costs and assessing the effectiveness and efficiency of these processes. Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback.
3. Evaluate the impact of data production tools on the effectiveness and quality of data production. Work closely with technical teams to enhance both the quality and effectiveness of these tools.
4. Proactively identify and mitigate potential biases and vulnerabilities in the data production process. This includes, but is not limited to, addressing human and system biases through the implementation of technical, product, and operational solutions.
Qualifications
1. Solid understanding of alignment and related approaches, such as Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and others. Or solid experience in moderation, labeling, search quality, or data synthesis.
2. Minimum of three years of experience as a product manager or product strategist, including process design experience.
3. A strong interest in both LLMs and human behavior/experience/wellbeing. Must be an enthusiastic learner. This position is not suitable for individuals who find reading papers and books to be tedious.
4. Collaborative team player who knows how to assertively advocate for their ideas without being overbearing. Skilled in maintaining attention to detail while staying focused on prioritized goals and the bigger picture.
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at rd.accommodations@tiktok.com.
Created: 2024-06-07
Reference: A72404A
Country: United States
State: California
City: San Jose
ZIP: 95118
Similar jobs:
-
Associate General Counsel, Regulatory and Product (Payments)
Meta in Los Angeles, California -
Product and Technology Strategist (Multiple Positions)
TikTok in San Jose, California💸 $167086 - $288216 per year -
Product Manager, Audience Targeting - Global Monetization Product and Technology - San Jose
TikTok in San Jose, California -
Product Manager - Monetization Safety, Trust and Safety, San Jose
TikTok in San Jose, California -
Product Marketing Manager - Prescription Smart Glasses / AR and Payer Strategy
Meta in Los Angeles, California -
Product Manager, Billing and Invoicing Platform
TikTok in San Jose, California -
Technical Program Manager III, AI and Machine Learning, Consumer Products
Google in Mountain View, California -
Senior Silicon SoC and Systems Architect, Products
Google in Mountain View, California -
Product Manager - Integrity and Authenticity - Trust & Safety, San Jose
TikTok in San Jose, California -
Global Product Solutions and Operations Manager, Search Ads
TikTok in Los Angeles, California -
Technical Program Manager III, Product Design, Tablets and Home
Google in Mountain View, California -
Senior Vice President, Product Development and Innovation - Remote
City of Hope in Duarte, California -
(USA) Manager, Marketplace Product Strategy and Op...
Walmart in SUNNYVALE, California💸 $91000.00 - $169000.0 per year -
Product BP - Trust and Safety - San Jose
TikTok in San Jose, California -
Regional HR Partner - Global Monetization Product and Technology - San Jose
TikTok in San Jose, California -
Senior Product Data Scientist, Fleet Deployment and Readiness
Waymo in Mountain View, California -
Director, Product Management, ML Frameworks and GenAI Ecosystems
Google in Mountain View, California -
Senior Technical Program Manager- Monetization Ads Product and Tech
TikTok in San Jose, California -
Senior Product Manager - Monetization Services and Experiences
Intuit in Mountain View, California -
Trust and Safety Product Operations Lead - USDS
TikTok in Mountain View, California