Research Engineer, Experimentation & Evaluation

Responsibilities

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

Our mission in the experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decisions for the products. The supported scenarios include recommendations, push, ads, search, mobile app, UI interaction and service upgrades etc.
Our platform's capabilities cover the entire experiment life cycle, from experiment design, experiment creation, metrics calculation, and statistical analysis to final evaluation and launch. In the process of rapid iteration, we provide reliable services for businesses to make bold hypotheses and cautious verification.

Position Responsibilities
- Analytics: Work independently to define, design, prototype, and implement complex exploratory analysis, w.r.t both theoretical and business perspectives.
- Methodology development: Leverage deep statistical expertise to improve and/or create methodologies
- Teamwork: Participate actively and thoughtfully in multidisciplinary teams to implement algorithms in production
- Communication: Effectively communicate insights and recommendations to support decisions on future research directions
- Mentorship: Oversee the analyses of junior statisticians and data scientists, and support their professional development

Qualifications

Minimum Qualification
- M.S. or Ph.D. in Statistics, Econometrics, Operations Research, Mathematics, Computer Science, or other quantitative fields
- Passion for solving unstructured and non-standard mathematical problems
- Expertise in experimental design and/or Bayesian inference & optimization
- Fluency with SQL or similar
- Proficiency with Python, or other interpreted programming languages like R or Matlab
Preferred Qualification
- Experience with Bayesian experiment/optimization system design
- Experience with quasi-experimental causal inference (Rubin causal model/ structural causal model/ instrumental variables etc.)
- In-depth understanding and hands-on experience in wielding tools like graphs.
- Experience with applying modern machine learning techniques and/or collaborating with ML scientists
- Excellent written and oral communication skills, including an ability to translate statistical methods and findings for a non-technical audience
- Comfortable with massive paper searching, reading and composing.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/cdpT2