Unlock Full Resume Report

New offer - be the first one to apply!

September 14, 2026

Software Engineer II

Mid • Remote

133,800 - 219,200 USD/yr

Quick Facts

  • Role: Software Engineer II (HPC/AI)
  • Focus: Networking infrastructure for large-scale AI training and inference
  • Environment: Azure Cloud

Description

The HPC/AI team builds distributed AI supercomputing infrastructure to enable breakthroughs in artificial intelligence by delivering unmatched computational power, scalability, and reliability. This role designs and builds next-generation networking capabilities to ensure high performance, low latency, and minimal jitter for distributed AI workloads.

Responsibilities

  • Design, develop, and optimize networking solutions tailored for large-scale AI training infrastructure
  • Architect and implement high-performance, low-latency, and low-jitter communication frameworks for distributed systems
  • Benchmark, analyze, and enhance the scalability and reliability of networking systems to handle petabyte-scale data transfer
  • Debug and resolve complex networking issues in large-scale, high-performance environments
  • Drive identification of dependencies and the development of design documents for a product, application, service, or platform
  • Create, implement, optimize, debug, refactor, and reuse code to establish and improve performance and maintainability, effectiveness, and return on investment (ROI)
  • Act as a Designated Responsible Individual (DRI); develop and follow the playbook; participate in on-call to monitor for degradation, downtime, or interruptions; alert stakeholders; initiate actions to restore service for issues when appropriate
  • Proactively seek new knowledge and adapt to new AI trends and patterns that improve availability, reliability, efficiency, observability, and performance while driving consistency in monitoring and operations at scale

Requirements

  • Bachelor’s Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python (or equivalent experience)
  • Ability to meet Microsoft, customer and/or government security screening requirements (including Microsoft Cloud Background Check: required upon hire/transfer and every two years thereafter)

Benefits

Certain roles may be eligible for benefits and other compensation. See https://careers.microsoft.com/us/en/us-corporate-pay

Similar jobs you might like