Senior AI Network Systems Engineer

Microsoft

Redmond, WA • 14m ago • Hybrid

Senior

Hybrid

119,800 - 234,700 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for Senior AI Network Systems Engineer role

Improve your resume now

$119,800 – $234,700/year

Quick Facts

  • Role: Senior AI Network Systems Engineer

Description

Lead the architecture, integration, validation, optimization, and deployment of large-scale AI networking infrastructure. This role focuses on Layer 3 and Layer 4 technologies, RDMA-based fabrics, and TCP/UDP transport behavior to support hyperscale AI training and inference. You will collaborate across networking, silicon, firmware, system software, validation, and Azure infrastructure teams to deliver reliable, high-performance AI networks.

Responsibilities

  • Define and develop networking requirements for large-scale AI training and inference clusters.
  • Collaborate across hardware and software teams to deliver scalable networking solutions from concept through datacenter deployment.
  • Influence next-generation AI networking roadmaps through architecture reviews.
  • Define concepts of operation, serviceability requirements, telemetry requirements, and operational models for AI infrastructure.
  • Lead design and validation of IP-based AI networking solutions (TCP/IP, UDP, routing, congestion management, flow control, QoS, traffic engineering).
  • Analyze transport-layer behavior and performance characteristics across distributed AI workloads.
  • Evaluate protocol implementations and debug issues affecting latency, throughput, scalability, and reliability.
  • Optimize network communication paths for distributed AI training and inference.
  • Design, validate, and optimize RDMA-based AI fabric solutions.
  • Analyze RDMA performance, congestion behavior, packet loss, retransmissions, and collective communication efficiency.
  • Develop validation methodologies for AI traffic patterns and collective communication workloads.
  • Develop and execute networking validation strategies (functionality, performance, scale, interoperability, resiliency, reliability).
  • Characterize network behavior under AI training and inference workloads.
  • Measure and assess latency, bandwidth utilization, congestion events, flow distribution, and workload communication patterns.
  • Create and automate network stress, scale, and performance qualification methodologies.
  • Lead end-to-end troubleshooting across physical, data link, network, and transport layers.
  • Perform packet-level analysis and protocol debugging using telemetry, packet captures, performance counters, and diagnostic tools.
  • Investigate issues across switches, NICs, RDMA, routing, and congestion control.
  • Drive corrective actions and long-term reliability improvements using fleet telemetry and lab validation.
  • Build and improve network observability, diagnostics, telemetry, and monitoring.
  • Develop tools and automation for network validation, performance analysis, and failure detection.
  • Improve engineering productivity via automated testing and network health assessment frameworks.

Requirements

  • Master’s degree in EE/CE/ME (or related) plus 3+ years technical engineering experience; or Bachelor’s degree plus 5+ years; or equivalent experience.
  • 5+ years experience developing or validating networking for accelerator-based systems.
  • 5+ years experience designing, integrating, validating, or troubleshooting Ethernet-based networking infrastructure including network switches.
  • 5+ years experience supporting AI, HPC, cloud, or large-scale data center infrastructure deployments.
  • Ability to pass required Microsoft, customer, and/or government security screening (including Microsoft Cloud Background Check).

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report