Summary
Do you have a passion for computer vision and deep learning problems? Are you interested in the latest development of the multi-modal models? The Data Analytic and Quality (DAQ) group is seeking a Machine Learning- Data Scientist to specialize in the evaluation of multimodal foundation models. This role involves collaboration with teams at Apple focused on developing foundation models, including ML engineers, data scientists, and ML Infrastructure engineers. Your primary responsibilities will include developing methods for the evaluation and improvement of foundation models, as well as refining the data used in training them, utilizing data centric AI approaches.

Key Qualifications
Experience in statistical data analysis and machine learning techniques
Solid foundation in data science, deep learning, computer vision, machine learning
Demonstrated experience in in-depth analysis of machine learning model failures
Proven expertise in data and model evaluation
Proficiency in Data Centric AI
Familiarity with various foundation models, such as SAM, LLAMA, LLaVA, CGPT4V, CLIP
Proficiency in at least one scripting language, preferably Python
Experience with analytical tools such as Jupyter, Pandas, NumPy, Matplotlib
Outstanding verbal and written communication skills, along with strong collaborative abilities
Experience in training models using frameworks like PyTorch, TensorFlow, Jax, etc
You are self-motivated and curious with demonstrated creative and critical thinking capabilities and a highly developed drive to improve how things work

Description
- Conduct failure analysis on large multimodal models and machine learning models
- Prototype novel evaluation and benchmark methods from foundation model literature research
- Develop tools for analyzing and visualizing data
- Design and implement experiment (DOE) for engineering studies and large scale user studies
- Facilitate and support data collection and analysis in collaboration with other groups
- Contribute in defining feature specifications and anticipated user experience based on data insights

Education & Experience
Minimum requirement of a bachelors degree

---