Senior AI Network Systems Engineer
Microsoft
Redmond, WA • 14m ago • Hybrid
Senior
Hybrid
119,800 - 234,700 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Senior AI Network Systems Engineer role
Improve your resume now
$119,800 – $234,700/year
Quick Facts
Role: Senior AI Network Systems Engineer
Description
Lead the architecture, integration, validation, optimization, and deployment of large-scale AI networking infrastructure. This role focuses on Layer 3 and Layer 4 technologies, RDMA-based fabrics, and TCP/UDP transport behavior to support hyperscale AI training and inference. You will collaborate across networking, silicon, firmware, system software, validation, and Azure infrastructure teams to deliver reliable, high-performance AI networks.
Responsibilities
- Define and develop networking requirements for large-scale AI training and inference clusters.
- Collaborate across hardware and software teams to deliver scalable networking solutions from concept through datacenter deployment.
- Influence next-generation AI networking roadmaps through architecture reviews.
- Define concepts of operation, serviceability requirements, telemetry requirements, and operational models for AI infrastructure.
- Lead design and validation of IP-based AI networking solutions (TCP/IP, UDP, routing, congestion management, flow control, QoS, traffic engineering).
- Analyze transport-layer behavior and performance characteristics across distributed AI workloads.
- Evaluate protocol implementations and debug issues affecting latency, throughput, scalability, and reliability.
- Optimize network communication paths for distributed AI training and inference.
- Design, validate, and optimize RDMA-based AI fabric solutions.
- Analyze RDMA performance, congestion behavior, packet loss, retransmissions, and collective communication efficiency.
- Develop validation methodologies for AI traffic patterns and collective communication workloads.
- Develop and execute networking validation strategies (functionality, performance, scale, interoperability, resiliency, reliability).
- Characterize network behavior under AI training and inference workloads.
- Measure and assess latency, bandwidth utilization, congestion events, flow distribution, and workload communication patterns.
- Create and automate network stress, scale, and performance qualification methodologies.
- Lead end-to-end troubleshooting across physical, data link, network, and transport layers.
- Perform packet-level analysis and protocol debugging using telemetry, packet captures, performance counters, and diagnostic tools.
- Investigate issues across switches, NICs, RDMA, routing, and congestion control.
- Drive corrective actions and long-term reliability improvements using fleet telemetry and lab validation.
- Build and improve network observability, diagnostics, telemetry, and monitoring.
- Develop tools and automation for network validation, performance analysis, and failure detection.
- Improve engineering productivity via automated testing and network health assessment frameworks.
Requirements
- Master’s degree in EE/CE/ME (or related) plus 3+ years technical engineering experience; or Bachelor’s degree plus 5+ years; or equivalent experience.
- 5+ years experience developing or validating networking for accelerator-based systems.
- 5+ years experience designing, integrating, validating, or troubleshooting Ethernet-based networking infrastructure including network switches.
- 5+ years experience supporting AI, HPC, cloud, or large-scale data center infrastructure deployments.
- Ability to pass required Microsoft, customer, and/or government security screening (including Microsoft Cloud Background Check).
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See moreSenior AI Engineer
Evertz
Senior
Technology
Warsaw, Poland · Remote
24k zł - 30k zł/yr
12 days ago
Senior Systems Engineer
Microsoft
Senior
Technology
Redmond, WA · Hybrid
$120k - $235k/yr
14m ago
Senior AI Engineer
Craftware
Senior
Technology
Warsaw, Poland · Remote
N/A
7 days ago

Senior AI Engineer
SNI
Senior
Technology
Wrocław, DL, Poland · On-site
N/A
8 days ago
Senior AI Engineer
Sealed Air Corporation
Senior
Technology
Charlotte, NC · On-site
$93k - $161k/yr
12 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior AI Engineer
Motion Recruitment Partners, LLC
Senior
Technology
Boston, MA, United States of America · On-site
$200k - $225k/yr
1h ago

Senior AI Platform Engineer
Fabrity S.A.
Senior
Technology
Warsaw, Poland · On-site
N/A
15h ago

Senior AI Engineer
The Evolvers Group
Senior
Technology
Remote
N/A
5 days ago

Senior Data Engineer
Luxoft
Senior
Technology
Irvine, CA · On-site
N/A
1h ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights