Senior Research Manager, AI Evaluation Science

Apple

Seattle, WA • 11m ago • On-site

Senior

On-site

225,600 - 338,400 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for Senior Research Manager, AI Evaluation Science role

Improve your resume now

$225,600 – $338,400/year

Quick Facts

  • Role: Senior Research Manager, AI Evaluation Science
  • Focus: Advance AI evaluation methods and productionize them into evaluation SDKs and APIs

Description

Lead an interdisciplinary research team advancing evaluation methods that can be shipped as production tools for AI developers. The team builds evaluation methodology and systems that are human-centered, psychometrically rigorous, and technically frontier. You will set the research agenda, manage the portfolio across near-term and long-term bets, and ensure methods are designed from the start for productionization.

Responsibilities

  • Set and execute the research strategy, balancing near-term capability work and longer-term scientific bets
  • Build and lead an interdisciplinary research team; recruit, develop, and retain research talent; mentor with a publication-and-translation culture
  • Maintain external research presence at top venues while delivering internally adopted evaluation capabilities
  • Design research projects from inception for productionization into self-service evaluation infrastructure
  • Partner with platform engineering and applied science teams to translate research into evaluation SDKs and APIs usable by engineers
  • Identify priority evaluation problems across the organization and ensure other teams can adopt outputs without needing your team to operate them
  • Enable productive interdisciplinary collaboration without flattening expertise
  • Represent the team as a visible leader in evaluation science at conferences, workshops, and research communities

Requirements

  • Ph.D. in Computer Science, Machine Learning, Statistics, or a closely related field
  • 5+ years managing or leading research teams in an industry setting
  • Publishing experience at top-tier AI/ML venues (NeurIPS, ICML, ICLR, ACL, EMNLP) or comparable statistics/measurement venues
  • Experience partnering with applied science and engineering teams to translate research into production systems, tools, or capabilities adopted by others
  • Technical depth in AI evaluation methods for measuring AI behavior (automated judgment, benchmark design, synthetic data, human evaluation, experimentation, failure analysis)
  • Ability to set research strategy, manage competing priorities, and make disciplined investment decisions
  • Excellent communication skills for executive leadership, partners, and the external research community

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report