Senior/Principal Software Engineer (AI Infrastructure)

Microsoft

Redmond, WA • 14m ago • Hybrid

Senior

Hybrid

119,800 - 234,700 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for Senior/Principal Software Engineer (AI Infrastructure) role

Improve your resume now

$119,800 – $234,700/year

Quick Facts

Senior/Principal Software Engineer focused on AI Infrastructure and distributed backend services for large model training and inference.

Role Description

Define engineering systems and developer productivity by building core compute services and AI infrastructure for AzureML. You will architect and develop high-scale distributed platforms with 24x7x365 availability, tight SLAs, and end-to-end solutions for customer impact.

Responsibilities

  • Design and develop core compute services powering AzureML using state-of-the-art LLM models (e.g., GPT-5 and open-source models)
  • Architect and build core AI infrastructure services for large scale training and inference
  • Develop, test, and maintain backend services in C#, Go, Rust, C++, hosted on Kubernetes and Docker
  • Develop and operate training/inference infrastructure frameworks and machine learning systems
  • Improve stability, efficiency, maintainability, low latency, and cloud security
  • Provide operational support and act as DRI
  • Collaborate with engineers, data scientists, internal research teams, and external enterprises
  • Provide technical leadership and vision to team members

Requirements

  • Bachelor’s degree in Computer Science (or related technical field) AND 4+ years engineering experience coding in C, C++, C#, Java, JavaScript, or Python (or equivalent experience)
  • Experience with large model training systems
  • 3+ years operating and designing systems that support large model training
  • Experience in distributed systems and architecture
  • AI infrastructure and workload knowledge
  • Ability to pass required security screening (including Microsoft Cloud Background Check)

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report