We are seeking an experienced senior engineering manager to lead Siri's intelligent services and platforms (iPhone, HomePod, CarPlay, Apple Watch, iPad, MacBook) evaluation and qualification. You will be responsible for partnerships with search engineering that will drive the test and evaluation strategy, frameworks, performance testing framework, and solutions that can scale. You will work alongside SW and ML engineering search teams as a critical partner. You will need to drive efficiency by adopting LLMs for testing and evaluation, including evaluators, auto-triage of issues, and auto-error-attribution.
This role will collaborate with Search Engineering teams, create a quality strategy in partnership with the roadmap, work on client integration and performance automation frameworks, and analyze results, ranking, and recall metrics as part of the evaluation. This is a fast-paced role with high visibility, impact, and influence in building one of the most advanced AI systems in the industry.