Senior Research Manager, AI Evaluation Science
Apple
Seattle, WA • 11m ago • On-site
Senior
On-site
225,600 - 338,400 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Senior Research Manager, AI Evaluation Science role
Improve your resume now
$225,600 – $338,400/year
Quick Facts
- Role: Senior Research Manager, AI Evaluation Science
- Focus: Advance AI evaluation methods and productionize them into evaluation SDKs and APIs
Description
Lead an interdisciplinary research team advancing evaluation methods that can be shipped as production tools for AI developers. The team builds evaluation methodology and systems that are human-centered, psychometrically rigorous, and technically frontier. You will set the research agenda, manage the portfolio across near-term and long-term bets, and ensure methods are designed from the start for productionization.
Responsibilities
- Set and execute the research strategy, balancing near-term capability work and longer-term scientific bets
- Build and lead an interdisciplinary research team; recruit, develop, and retain research talent; mentor with a publication-and-translation culture
- Maintain external research presence at top venues while delivering internally adopted evaluation capabilities
- Design research projects from inception for productionization into self-service evaluation infrastructure
- Partner with platform engineering and applied science teams to translate research into evaluation SDKs and APIs usable by engineers
- Identify priority evaluation problems across the organization and ensure other teams can adopt outputs without needing your team to operate them
- Enable productive interdisciplinary collaboration without flattening expertise
- Represent the team as a visible leader in evaluation science at conferences, workshops, and research communities
Requirements
- Ph.D. in Computer Science, Machine Learning, Statistics, or a closely related field
- 5+ years managing or leading research teams in an industry setting
- Publishing experience at top-tier AI/ML venues (NeurIPS, ICML, ICLR, ACL, EMNLP) or comparable statistics/measurement venues
- Experience partnering with applied science and engineering teams to translate research into production systems, tools, or capabilities adopted by others
- Technical depth in AI evaluation methods for measuring AI behavior (automated judgment, benchmark design, synthetic data, human evaluation, experimentation, failure analysis)
- Ability to set research strategy, manage competing priorities, and make disciplined investment decisions
- Excellent communication skills for executive leadership, partners, and the external research community
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Senior AI Engineer
The Evolvers Group
Senior
Technology
Remote
N/A
3 days ago
Senior AI Solutions Engineer
PEOPLEMORE P.S.A.
Senior
Technology
Kraków, Poland · Remote
N/A
13 days ago

AI Evaluation Researcher
Figma
Senior
Technology
San Francisco, CA · On-site
$169k - $250k/yr
7 days ago

Senior Software Engineer
Snorkel AI
Senior
Technology
Remote
$208k - $315k/yr
3 days ago

Senior AI Agent Engineer
Traba
Senior
Technology
New York City, NY · On-site
$200k - $240k/yr
6 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.
Senior Human-Centered AI Researcher, Personal Intelligence & Experiences
Apple
Senior
Technology
Cupertino, CA · On-site
$185k - $325k/yr
10 days ago
Senior Machine Learning Platform Engineer (Evaluation)
Apple
Senior
Technology
Seattle, WA · On-site
$175k - $309k/yr
10 days ago

Senior AI Engineer, Finance AI & Automation
Bank of Montreal
Senior
Technology
Chicago, IL · On-site
$120k - $250k/yr
4 days ago
Senior AI Engineer
Evertz
Senior
Technology
Warsaw, Poland · Remote
24k zł - 30k zł/yr
10 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights