Senior Software Engineer, AI Frameworks

Quick Facts

• Role: Senior Software Engineer, AI Frameworks (individual contributor)

Description

Own significant components across AI performance, benchmarking, automation, and developer tooling. Build and operate production-quality components spanning AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations, then benchmark, profile, debug, and optimize large language model training and inference on GPUs and Microsoft hardware. Collaborate cross-team to deliver measurable improvements into production.

Responsibilities

• Design, implement, test, and operate production-quality components for AI frameworks, runtimes, benchmarking, and performance tooling
• Benchmark, profile, debug, and optimize LLM training and inference workloads across GPU and Microsoft hardware
• Build automation and observability to detect regressions, improve reproducibility, and accelerate onboarding
• Drive scoped projects from problem definition through deployment with focus on delivery speed, maintainability, reliability, and impact
• Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues
• Participate in technical design reviews, engineering standards, operational health, and mentor other engineers

Requirements

• Bachelor’s degree in Computer Science or related technical field
• 4+ years of technical engineering experience coding in C++ and/or Python (or equivalent)
• Ability to meet Microsoft security screening requirements, including the Microsoft Cloud background check

Benefits

• Certain roles may be eligible for benefits and other compensation