Senior/Principal Software Engineer (AI GPU Performance)
Microsoft
Redmond, WA • 1h ago • Remote
Senior
Remote
142,800 - 274,800 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Senior/Principal Software Engineer (AI GPU Performance) role
Improve your resume now
$142,800 – $274,800/year
Quick Facts
Role: Senior and/or Principal Software Engineer focusing on AI GPU performance
Focus: Optimizing LLM serving for lower latency, higher throughput, and better hardware efficiency
Description
You will build and optimize GPU kernels and distributed inference runtime systems for an LLM serving stack at cloud scale. The work emphasizes disciplined measurement, deep performance expertise, and collaboration across model, compiler, infrastructure, and hardware teams. Senior engineers deliver performance improvements from investigation to production; Principal engineers solve the hardest cross-stack bottlenecks and create reusable capabilities.
Requirements
Bachelor’s degree in Computer Science or related technical field
4+ years of technical engineering experience coding in C++ and/or Python (or equivalent)
Ability to pass required security screenings, including the Microsoft Cloud background check
Senior: strong GPU/accelerator programming and kernel optimization; familiarity with vLLM or SGLang (or equivalent LLM inference libraries)
Principal: deep expertise in GPU/accelerator compilation pipelines and low-level architecture, plus LLM training/inference parallelism and acceleration
Hard Skills and Technologies
C++
Python
GPU
kernel optimization
profiling
performance measurement
distributed inference
inference runtime
compilation pipelines
vLLM
SGLang
parallelism
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See moreSenior/Principal Software Engineer (AI Performance)
Microsoft
Senior
Technology
Remote
N/A
10 days ago
Principal AI Software Engineer
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$143k - $275k/yr
9 days ago
Senior Software Engineer - Performance Tooling
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$120k - $235k/yr
14 days ago
Principal Software Engineer, AI Frameworks
Microsoft
Senior
Technology
Remote
$143k - $275k/yr
4 days ago

Principal Machine Learning Engineer (AI)
Next Step Systems
Senior
Technology
Remote
$170k - $200k/yr
3 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.
Senior/Principal Software Engineer (AI Infrastructure)
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$120k - $235k/yr
3 days ago
Principal Engineer, On-Device Inference & GPU Kernels
Opera Software
Senior
Technology
Warsaw, Poland · On-site
N/A
2 days ago

Principal AI Python Developer
ITDS
Senior
Technology
Warsaw, Pl-02, Poland · Remote
N/A
10 days ago
Principal Software Engineer, Core AI
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$143k - $275k/yr
10 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights