Senior/Principal Software Engineer (AI GPU Performance)

Microsoft

Redmond, WA • 1h ago • Remote

Senior

Remote

142,800 - 274,800 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Or go to the original job offer

Potential salary for Senior/Principal Software Engineer (AI GPU Performance) role

Improve your resume now

$142,800 – $274,800/year

Quick Facts

  • Role: Senior and/or Principal Software Engineer focusing on AI GPU performance

  • Focus: Optimizing LLM serving for lower latency, higher throughput, and better hardware efficiency

Description

You will build and optimize GPU kernels and distributed inference runtime systems for an LLM serving stack at cloud scale. The work emphasizes disciplined measurement, deep performance expertise, and collaboration across model, compiler, infrastructure, and hardware teams. Senior engineers deliver performance improvements from investigation to production; Principal engineers solve the hardest cross-stack bottlenecks and create reusable capabilities.

Requirements

  • Bachelor’s degree in Computer Science or related technical field

  • 4+ years of technical engineering experience coding in C++ and/or Python (or equivalent)

  • Ability to pass required security screenings, including the Microsoft Cloud background check

  • Senior: strong GPU/accelerator programming and kernel optimization; familiarity with vLLM or SGLang (or equivalent LLM inference libraries)

  • Principal: deep expertise in GPU/accelerator compilation pipelines and low-level architecture, plus LLM training/inference parallelism and acceleration

Hard Skills and Technologies

  • C++

  • Python

  • GPU

  • kernel optimization

  • profiling

  • performance measurement

  • distributed inference

  • inference runtime

  • compilation pipelines

  • vLLM

  • SGLang

  • parallelism

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report