Senior/Principal Software Engineer (AI Infrastructure)
Microsoft
Redmond, WA • 14m ago • Hybrid
Senior
Hybrid
119,800 - 234,700 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Senior/Principal Software Engineer (AI Infrastructure) role
Improve your resume now
$119,800 – $234,700/year
Quick Facts
Senior/Principal Software Engineer focused on AI Infrastructure and distributed backend services for large model training and inference.
Role Description
Define engineering systems and developer productivity by building core compute services and AI infrastructure for AzureML. You will architect and develop high-scale distributed platforms with 24x7x365 availability, tight SLAs, and end-to-end solutions for customer impact.
Responsibilities
- Design and develop core compute services powering AzureML using state-of-the-art LLM models (e.g., GPT-5 and open-source models)
- Architect and build core AI infrastructure services for large scale training and inference
- Develop, test, and maintain backend services in C#, Go, Rust, C++, hosted on Kubernetes and Docker
- Develop and operate training/inference infrastructure frameworks and machine learning systems
- Improve stability, efficiency, maintainability, low latency, and cloud security
- Provide operational support and act as DRI
- Collaborate with engineers, data scientists, internal research teams, and external enterprises
- Provide technical leadership and vision to team members
Requirements
- Bachelor’s degree in Computer Science (or related technical field) AND 4+ years engineering experience coding in C, C++, C#, Java, JavaScript, or Python (or equivalent experience)
- Experience with large model training systems
- 3+ years operating and designing systems that support large model training
- Experience in distributed systems and architecture
- AI infrastructure and workload knowledge
- Ability to pass required security screening (including Microsoft Cloud Background Check)
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Principal Software Engineer, Cloud Security Platform
PaloAlto Networks
Senior
Technology
CA, United States of America · On-site
$156k - $253k/yr
5 days ago
Principal Software Engineer
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$143k - $275k/yr
1 days ago

Software Engineer, Systems and Infrastructure
Mid
Technology
Mountain View, CA · Hybrid
$120k - $195k/yr
4 days ago
Principal Software Engineer, Core AI
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$143k - $275k/yr
7 days ago
Principal Software Engineer
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$166k - $296k/yr
11 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.
Principal Software Engineer, AI Frameworks
Microsoft
Senior
Technology
Remote
$143k - $275k/yr
1 days ago

Principal AI Python Developer
ITDS
Senior
Technology
Warsaw, Pl-02, Poland · Remote
N/A
7 days ago
Principal Software Engineer - Cloud Infrastructure & AI Systems
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$143k - $275k/yr
6 days ago
Principal Software Engineer
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$166k - $296k/yr
1 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights