Senior Software Engineer, Performance Tooling

Quick Facts

• Role: Senior Software Engineer – Performance Tooling

Description

Work across multiple layers of the AI software stack to enable large-scale training and inference of AI models. Benchmark OpenAI and other LLMs on GPUs and Microsoft hardware, then debug, profile, and optimize performance for CPU/GPU training and inference workloads. Monitor performance regressions and drive improvements that reduce time-to-deploy and the hardware footprint.

Responsibilities

• Enable large-scale model training and inference across abstractions, programming models, compilers, runtimes, libraries, and APIs

• Benchmark OpenAI and other LLMs for performance on GPUs and Microsoft hardware

• Debug, profile, and optimize training/inference performance on CPUs/GPUs

• Monitor performance regressions and reduce time-to-deploy and hardware footprint

• Collaborate with researchers and engineers to deliver scalable, production-ready performance improvements

Requirements

• Bachelor’s degree in Computer Science or related technical field AND 4+ years of technical engineering experience coding in C++ or Python (or equivalent)

• 4+ years practical experience in high performance applications and performance debugging/optimization on CPUs/GPUs

• Ability to meet security screening requirements, including passing the Microsoft Cloud background check and re-screening every two years

Benefits

Certain roles may be eligible for benefits and other compensation.