Principal Software Engineer, AI Infrastructure

Quick Facts

• Role: Principal Software Engineer, AI Infrastructure

Description

You will design and build the infrastructure platform that routes, prioritizes, and matches AI traffic to available GPU capacity across regions. You’ll lead distributed-systems design, deliver secure and well-tested routing and capacity planning code, and work with partner teams to ensure global performance, reliability, and cost efficiency. You’ll also take part in on-call operations as a DRI for critical AI services and help improve monitoring and incident learnings.

Responsibilities

• Own end-to-end design for managing AI traffic and computing capacity across regions, balancing speed, reliability, scale, and cost

• Write and review clear, secure, well-tested code for routing, prioritization, and capacity planning; define reusable coding practices

• Convert long-term product vision into a step-by-step roadmap; use feature flags and gradual rollouts to validate impact and enable fast rollback

• Serve as DRI in on-call rotation for critical AI services; lead post-incident reviews and improve monitoring

• Partner with product, research, and infrastructure to understand customer requirements for new AI models/capabilities; ensure testing and support paths are ready before launch

• Ensure services are secure, private, and compliant via threat modeling and safe deployment checks; mentor engineers

• Use AI tools and agents across the SDLC (code/tests/investigating live issues) following Responsible AI practices

Requirements

• Bachelor’s degree in Computer Science or related technical field

• 6+ years of technical engineering experience building distributed systems with coding in C#, Java, or Go (or equivalent)

• Ability to meet security screening requirements, including passing the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Benefits

• Influence the design of large-scale AI infrastructure used globally

• Develop as a trusted technical leader through mentorship and engineering excellence