Senior Software Engineer (LLM Evaluation & Test Infrastructure)

Apple

Cupertino, CA • 15m ago • On-site

Senior

On-site

216,200 - 324,800 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Or go to the original job offer

Potential salary for Senior Software Engineer (LLM Evaluation & Test Infrastructure) role

Improve your resume now

$216,200 – $324,800/year

Quick Facts

  • Senior role focused on LLM evaluation and test/validation infrastructure for generative AI models

Description

Define and develop generative AI validation infrastructure in collaboration with cross-functional partners across ML, data science, software engineering, and product management. Build or adopt client and server CI pipelines and scalable automation tools and frameworks to enable rigorous testing for accuracy, performance, reliability, and stability across products and use cases. Work with product and program teams to align validation infrastructure with the roadmap and drive adoption among product and ML engineers.

Responsibilities

  • Design and develop LLM online and offline validation infrastructure, tools, frameworks, and methodologies
  • Implement or enhance client/server CI pipelines for generative AI validation
  • Create scalable automation for evaluation across all supported platforms
  • Enable cross-functional teams to run rigorous model testing (accuracy, performance, reliability, stability)
  • Coordinate validation infrastructure development in lockstep with product and feature roadmaps

Benefits

  • High visibility, impact, and influence building advanced generative AI systems
  • Fast-paced environment with meaningful cross-team collaboration

Requirements

  • BS/MS in Computer Science, Machine Learning, or related field
  • 6+ years of proven software development expertise in Java, Python, Swift, or Objective-C
  • Strong ability to build scalable and robust infrastructure for training/inference pipelines using on-device and server-side ML models
  • Fundamental knowledge of ML concepts and of ML-based product lifecycle and operations
  • Familiarity with ML toolkits such as PyTorch, TensorFlow, and scikit-learn
  • Hands-on experience building automation infrastructure, tools, and frameworks for large-scale AI/ML or cloud-based applications
  • Demonstrated experience evaluating and testing machine learning models, including performance metrics, validation techniques, and statistical analysis

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report