AI Research Scientist, Language - Reality Labs

The Wearables Voice AI team supports speech-based interaction on wearable devices for on-line and on-device scenarios. As a Research Scientist in Wearables Voice AI, you will have the opportunity to perform ground-breaking research to advance the device-driven AI Assistant effort at Meta - e.g. RayBan Smart Glasses and future Wearable devices. You will build state-of-the-art LLMs, optimize them for natural voice interaction on our unique hardware (multiple microphones, other sensors, on-device inference, etc), deliver knowledge-grounded, actionable, personalized AI through a unique voice user interface. You will collaborate closely with Meta GenAI and FAIR orgs to produce SOTA research and translate this into products.

AI Research Scientist, Language - Reality Labs Responsibilities

• Be a leader in our efforts to understand and synthesize speech, translate between languages, and/ or extract intents, concepts, or other relevant features from speech and link them to downstream tasks.


• Independently design and implement algorithms, train state of the art models on large data, and optimize their performance together with our team and partners.


• Perform research to tackle unsolved real-world problems and advance state of the art research by developing internal tests and mapping them to external benchmarks.


• Develop machine learning models for both server-based and embedded systems.


• Contribute research that can be applied to Meta product development. Publish it.

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.


• Has PhD in the field of Artificial Intelligence, a related field, or equivalent practical experience. Degree must be completed prior to joining Meta.


• 3+ year(s) of work experience in a university, industry, or government lab with emphasis on AI Research in speech recognition, speech synthesis, natural language understanding, machine learning, deep learning, or related fields.


• Experience with development and implementation of speech recognition algorithm/ systems and model training, including LLMs.


• Experience working with machine learning libraries like Pytorch, Tensorflow, etc.


• Familiar with scripting languages such as Python and shell scripts.


• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.

Preferred Qualifications

• Experience with developing scalable machine learning models in at least one of the following areas: automatic speech recognition, speech synthesis, LLM, or relevant areas.


• Experience with large scale model training, implementing algorithms, and evaluating speech-based systems.


• Proven track record of achieving significant results as demonstrated by publications at leading workshops, journals or conferences such as ICASSP, INTERSPEECH, NeurIPS, ICML, ICLR, or similar.


• Experience taking ideas from research to production.


• Experience solving complex problems and comparing alternative solutions, tradeoffs, and diverse points of view to determine a path forward.


• Experience working and communicating cross functionally in a team environment