Cloud Principal Hardware Reliability Engineer

Quick Facts

• Role focus: Scale Azure AFPD (Fault Prediction and Detection) across server hardware components for the cloud fleet

• Scope: Server components and live-site incident leadership; collaboration with software and data science teams

Description

You will lead failure analysis and hands-on hardware resiliency for AFPD, turning hardware, firmware, and OS telemetry into early detection and prediction of failures.

You will define signals/thresholds and targeted diagnostics and repair recipes, improve detection/isolation accuracy, and feed learnings back into the platform to improve customer uptime at massive scale.

You’ll also serve as a senior escalation point for live-site incidents and help ready new server generations and AI/GPU platforms for production.

Responsibilities

• Lead failure analysis across server components using fleet telemetry and logs; confirm root cause using repair outcomes and supplier failure analysis

• Define signals, thresholds, targeted diagnostics, and repair recipes; partner with component teams for root-cause analysis

• Improve isolation accuracy so repairs address the true source of failures

• Collaborate with software engineers and data scientists to create detection rules and prediction models; set precision targets and validation gates before production actions

• Use AI-powered tools and data-driven insights to analyze hardware failures and improve server performance and availability

• Lead root cause and corrective actions with server components, including firmware fixes; feed learnings back into AFPD

• Act as senior hardware escalation for live-site incidents (triage through root cause to fleet-wide mitigation)

• Ensure new server generations and AI/GPU platforms are platform-ready before production launch, including detection/isolation/repair coverage

• Track and improve metrics and mentor engineers

Requirements

• Master’s degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience, OR Bachelor’s degree AND 8+ years technical engineering experience, OR equivalent experience

• Ability to meet Microsoft security screening requirements, including passing Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

• Preferred: 10+ years in server hardware reliability, failure analysis, or fleet resiliency at cloud or datacenter scale

• Preferred: Technical depth in failure modes of at least one server component type and working knowledge across server subsystems (BMC, PCIe, firmware)

• Preferred: Experience converting failure signatures into automated detection rules/fault codes/repair procedures for large fleets

• Preferred: Experience with predictive maintenance/anomaly detection on hardware telemetry with precision targets and automated repair actions

• Preferred: Proficiency with Kusto (Azure Data Explorer) or SQL, and Python or PowerShell for large-scale telemetry analysis

• Preferred: Experience using AI-powered tools, machine learning technologies, or advanced analytics for engineering/troubleshooting/process improvements

• Preferred: Experience with NPI and hardware qualification for server platforms

Benefits

• Certain roles may be eligible for benefits and other compensation (details provided via company careers/pay information)

• Typical base pay range in the U.S.: USD $142,800–$274,800 per year (location-dependent ranges apply)