Senior/Principal Software Engineer, AI Frameworks

Quick Facts

• Role: Senior and/or Principal Software Engineer (AI Frameworks)

• Focus: AI frameworks, AI performance, benchmarking, automation/observability, developer tooling

Description

Join a team building software and performance systems that enable state-of-the-art AI models to run reliably and efficiently at cloud scale. You will partner across models, hardware, frameworks, and production services to accelerate model onboarding, improve performance and reliability, and reduce deployment time and hardware footprint.

Responsibilities

• Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.

• Benchmark, profile, debug, and optimize LLM training and inference workloads across GPUs and Microsoft hardware.

• Build automation and observability to detect regressions, improve reproducibility, surface actionable insights, and accelerate onboarding.

• Drive projects from problem definition through deployment with attention to delivery speed, maintainability, reliability, and measurable impact.

• Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions.

• Contribute to technical design reviews, operational health, engineering standards, and mentoring.

• Principal: Define technical vision/architecture and multi-release strategy; lead ambiguous cross-stack investigations across models, frameworks, compilers, runtimes, systems, services, and silicon.

• Principal: Establish scalable measurement/automation/observability mechanisms and drive improvements in onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.

Benefits

• Base pay ranges (U.S.): Senior Software Engineer typically USD $142,800–$274,800; Principal Software Engineer typically USD $119,800–$234,700, with different ranges for San Francisco Bay Area and NYC metro.

• Eligibility for benefits and other compensation may apply.