Senior Site Reliability Engineer

Quick Facts

• Senior production engineering role focused on SRE, reliability automation, and Kubernetes-based GPU cluster operations

Description

Build and operate automation for large-scale Kubernetes clusters across cloud partner and on-prem environments. Develop tools and services for provisioning, validation, upgrades, monitoring, repair, and cluster lifecycle operations, while improving Day 0/1/2 workflows and reducing manual production touches through APIs and GitOps. Define SLOs/SLIs, monitor error allowances, streamline reporting, and participate in on-call incident response and durable follow-up.

Responsibilities

• Build and operate automation for large-scale Kubernetes clusters (NCP and on-prem)
• Develop tooling for cluster provisioning, validation, upgrades, monitoring, repair, and lifecycle operations
• Improve Day 0/Day 1/Day 2 workflows for bringup, handoff, and production operations
• Define SLOs/SLIs and monitor error allowances; streamline reliability reporting
• Reduce manual production touches using APIs, GitOps, and agent-assisted workflows
• Participate in on-call, incident response, debugging, and durable follow-up
• Partner with platform, storage, networking, security, and workload teams to make infrastructure production-ready

Requirements

• 8+ years of experience building or operating production infrastructure
• Strong programming skills in Python, Go, or similar
• Expert-level knowledge of Linux, Kubernetes, containers, cloud infrastructure, or infrastructure automation
• Solid grasp of SRE principles: SLOs, SLIs, error budgets, incident management
• Ability to troubleshoot distributed systems in production
• Experience building and operating comprehensive observability stacks (monitoring, logging, tracing), including OpenTelemetry, Prometheus, Grafana, ELK Stack, Lightstep, Splunk
• Clear communication and cross-team collaboration
• BS/MS in Computer Science or equivalent experience

Benefits

• Base salary determined by location and experience; equity eligibility and benefits included
• Base salary range: 168,000 USD - 270,250 USD (Level 4) and 208,000 USD - 333,500 USD (Level 5)