Principal AI Back-End Network Systems Lead

Microsoft

Mountain View, CA • 9m ago • Hybrid

Senior

Hybrid

142,800 - 274,800 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for Principal AI Back-End Network Systems Lead role

Improve your resume now

$142,800 – $274,800/year

Quick Facts

  • Role: Principal AI Back-End Network Systems Lead (technical lead and end-to-end product owner for Back End Network)

Description

Lead end-to-end product development for back-end AI networking across both scale-up and scale-out, from requirements and architecture through integration, validation, manufacturing readiness, deployment, and fleet learning. Translate AI training and inference requirements into measurable system targets (e.g., bandwidth, latency, scale, reliability, power, cost, and schedule) and drive cross-layer decisions across physical/data-link/network/transport layers and above. Provide technical leadership connecting networking behavior to distributed AI workloads, collectives, observability, and datacenter deployment.

Responsibilities

  • Own the Back End Network product definition and execution plan across scale-up and scale-out.
  • Drive cross-system architecture decisions, interface contracts, feature priorities, risk tradeoffs, and product readiness metrics.
  • Lead NUDD technology assessments, prototyping, make/buy/partner decisions, and mitigation plans for key product risks.
  • Architect and integrate across accelerator/networking silicon, NICs/DPUs, PHYs/retimers, switch ASICs, cables/backplanes, optics, and fabric topology.
  • Define scalable scale-up/scale-out architectures (topology, radix, reach, link speeds, routing, path diversity, oversubscription, failure domains, resiliency).
  • Drive cross-layer Ethernet/RDMA (or similar) protocol behavior, including flow control, congestion control, QoS, telemetry, and security.
  • Model and predict bandwidth/latency/congestion/failure and collective efficiency; use simulation/emulation/prototypes and lab/fleet data to set performance budgets.
  • Lead end-to-end validation (functionality, interoperability, performance, scale, stress, resiliency, reliability, security, serviceability, and upgrade/recovery).
  • Lead bring-up and root-cause analysis using telemetry, packet captures, counters, diagnostics, and lab characterization.
  • Define production qualification, manufacturing test, deployment/monitoring, rollback, and fleet-health requirements; use operational learning to improve next-generation designs.
  • Create technical alignment across architecture, silicon, hardware, optics, firmware, networking, software, validation, manufacturing, and datacenter/workload teams; mentor engineers and communicate risks/tradeoffs.

Requirements

  • Master’s degree (Electrical Engineering, Computer Engineering, Mechanical Engineering, or related) and 7+ years technical engineering experience; OR Bachelor’s degree and 8+ years; OR equivalent experience.
  • Meet Microsoft/customer/government security screening requirements, including passing the Microsoft Cloud background check on hire/transfer and every two years.

Benefits

  • Competitive base pay range (U.S.) for Hardware Engineering IC5: USD $142,800–$274,800 per year; SF Bay Area and NYC metro: USD $188,000–$304,200 per year.
  • Eligibility for benefits and other compensation (details available via Microsoft careers pay information link).

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report