Principal AI Back-End Network Systems Lead
Microsoft
Mountain View, CA • 9m ago • Hybrid
Senior
Hybrid
142,800 - 274,800 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Principal AI Back-End Network Systems Lead role
Improve your resume now
$142,800 – $274,800/year
Quick Facts
- Role: Principal AI Back-End Network Systems Lead (technical lead and end-to-end product owner for Back End Network)
Description
Lead end-to-end product development for back-end AI networking across both scale-up and scale-out, from requirements and architecture through integration, validation, manufacturing readiness, deployment, and fleet learning. Translate AI training and inference requirements into measurable system targets (e.g., bandwidth, latency, scale, reliability, power, cost, and schedule) and drive cross-layer decisions across physical/data-link/network/transport layers and above. Provide technical leadership connecting networking behavior to distributed AI workloads, collectives, observability, and datacenter deployment.
Responsibilities
- Own the Back End Network product definition and execution plan across scale-up and scale-out.
- Drive cross-system architecture decisions, interface contracts, feature priorities, risk tradeoffs, and product readiness metrics.
- Lead NUDD technology assessments, prototyping, make/buy/partner decisions, and mitigation plans for key product risks.
- Architect and integrate across accelerator/networking silicon, NICs/DPUs, PHYs/retimers, switch ASICs, cables/backplanes, optics, and fabric topology.
- Define scalable scale-up/scale-out architectures (topology, radix, reach, link speeds, routing, path diversity, oversubscription, failure domains, resiliency).
- Drive cross-layer Ethernet/RDMA (or similar) protocol behavior, including flow control, congestion control, QoS, telemetry, and security.
- Model and predict bandwidth/latency/congestion/failure and collective efficiency; use simulation/emulation/prototypes and lab/fleet data to set performance budgets.
- Lead end-to-end validation (functionality, interoperability, performance, scale, stress, resiliency, reliability, security, serviceability, and upgrade/recovery).
- Lead bring-up and root-cause analysis using telemetry, packet captures, counters, diagnostics, and lab characterization.
- Define production qualification, manufacturing test, deployment/monitoring, rollback, and fleet-health requirements; use operational learning to improve next-generation designs.
- Create technical alignment across architecture, silicon, hardware, optics, firmware, networking, software, validation, manufacturing, and datacenter/workload teams; mentor engineers and communicate risks/tradeoffs.
Requirements
- Master’s degree (Electrical Engineering, Computer Engineering, Mechanical Engineering, or related) and 7+ years technical engineering experience; OR Bachelor’s degree and 8+ years; OR equivalent experience.
- Meet Microsoft/customer/government security screening requirements, including passing the Microsoft Cloud background check on hire/transfer and every two years.
Benefits
- Competitive base pay range (U.S.) for Hardware Engineering IC5: USD $142,800–$274,800 per year; SF Bay Area and NYC metro: USD $188,000–$304,200 per year.
- Eligibility for benefits and other compensation (details available via Microsoft careers pay information link).
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See morePrincipal Hardware Engineer, Networking
Microsoft
Senior
Technology
Mountain View, CA · Hybrid
$143k - $275k/yr
5 days ago

Principal Software Engineer
Microsoft Corporation
Senior
Technology
Redmond, WA, United States of America · On-site
$143k - $275k/yr
6 days ago
Principal Software Engineer
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$143k - $275k/yr
10 days ago
Principal Software Engineer, AI Infrastructure Management & Operations
Microsoft
Senior
Technology
Remote
$143k - $275k/yr
4 days ago
Lead Backend Engineer
Gardens Interactive
Senior
Technology
Remote
$196k - $203k/yr
8 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Lead Machine Learning Platform Consultant
Allstate Insurance Company
Senior
Technology
Chicago, IL · On-site
$110k - $181k/yr
4 days ago
AI Team Leader (k/m/n)
Nexio Management Sp. z o. o.
Senior
Technology
Warsaw, Poland · On-site
N/A
13 days ago
Tech Lead / Senior .NET Developer (Product Development & AI)
Jobs Contact Personal, s.r.o.
Senior
Technology
Brno, Czech Republic · Remote
960k Kč - 1200k Kč/yr
12 days ago

Lead Software Engineer - Enterprise AI Services & Agents
Wellmark
Senior
Technology
Des Moines, IA · On-site
N/A
8 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights