Senior Data Scientist, Evaluation

Quick Facts

• Senior Data Scientist focused on evaluation and measurement

Description

Develop and research evaluation methods to improve the quality of Apple user-facing products and services (e.g., Siri and Apple Intelligence). Partner with evaluation/experimentation engineering teams to translate methodological advances into technologies used by product engineering teams. Work with large, complex datasets to solve non-routine analysis problems, including prompt engineering and building LLMs as judges.

Responsibilities

• Research and develop evaluation methods for product quality
• Collaborate with evaluation/experimentation engineering teams to operationalize methods into production-ready technologies
• Conduct analysis including data collection and quality control, requirements specification, processing, and presentations
• Build and prototype analysis pipelines iteratively to deliver insights at scale
• Develop deep knowledge of product data structures and metrics; advocate for data/metric changes for product development
• Partner closely with product engineering teams on core ML algorithms and user experience evaluations

Requirements

• Advanced degree in a quantitative field (e.g., Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics)
• Proficiency in data science, machine learning, and analytics, including statistical data analysis
• Experience crafting, conducting, analyzing, and interpreting experiments/investigations, especially for data quality, evaluation, and risk assessment
• Strong programming skills, including data querying (SQL and/or Spark)
• Experience with a scripting language for data processing and development (Python, R, or Scala)
• Ability to translate business questions into statistical analyses using available data
• Strong communication skills to explain difficult technical (especially causal) topics to data scientists, engineers, and business partners

Benefits

• Opportunity to deliver search experiences across multiple Apple platforms and languages
• Role involves a wide variety of skills and innovation