Infrastructure Software Engineer

Epiq

New York, NY • 1h ago • On-site

Senior

On-site

180,000 - 260,000 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Potential salary for Infrastructure Software Engineer role

Improve your resume now

$180,000 – $260,000/year

Quick Facts

  • Role: Infrastructure Software Engineer

  • Focus: Cloud infrastructure and automation for an AI platform (IaaC, Kubernetes, CI/CD, networking, secrets, observability)

Description

Build and operate the cloud infrastructure and automation behind an AI platform, including Infrastructure as Code, Kubernetes, CI/CD, networking, secrets, and observability across Azure, AWS, and on-prem GPU environments. You will own infrastructure reliability, scalability, and security and partner with backend, AI, product, and security teams to standardize deployment, observability, and security patterns. Responsibilities include Terraform module development, production Kubernetes operations, progressive delivery for zero-downtime rollouts, GPU infrastructure operations, SLOs and compliance infrastructure, and on-call incident response.

Responsibilities

  • Write, test, review, and maintain reusable Terraform modules and infrastructure automation for provisioning, environment configuration, and drift detection/remediation

  • Operate production Kubernetes: orchestration, autoscaling, resource governance, network policy, and cluster lifecycle management

  • Build and maintain CI/CD and GitOps release automation with progressive delivery, safe rollback, and protection of in-flight requests and long-running jobs

  • Operate cloud and on-prem GPU infrastructure for model-serving reliability, cluster management and scheduling, utilization/cost, and observability

  • Define platform SLOs and implement metrics, tracing, alerting, and error-budget practices

  • Implement security and compliance infrastructure including hardening, audit logging, data-residency controls, retention, legal hold, and audit evidence collection

  • Build and maintain network, secrets/key/credential, TLS, and certificate-lifecycle infrastructure

  • Use AI coding agents while owning outcomes (design/specs/test plans, code review, and verification of correctness, security, and maintainability) and ship major changes behind automated tests and controlled rollouts

  • Build and maintain AI-native developer tooling and technical design documentation; contribute to architectural reviews

  • Participate in on-call rotation and incident response; maintain runbooks and backup/restore procedures; convert incident findings into lasting fixes

  • Senior+ only: Define foundational infrastructure architecture and patterns; lead migrations/modernization/capacity planning while protecting production availability

  • Senior+ only: Raise the engineering bar through reusable platform primitives, mentoring, and cross-team technical leadership while staying hands-on

Requirements

  • 3+ years of professional experience in infrastructure engineering, platform engineering, or site reliability engineering

  • Production experience operating systems with on-call responsibility

  • Hands-on experience with AWS, Google Cloud Platform, or Azure

  • Infrastructure as code with Terraform, including reusable module design

  • Production Kubernetes experience (scaling, upgrades, resource limits, network policy, troubleshooting)

  • CI/CD pipeline ownership using GitHub Actions, Azure DevOps, or comparable platforms

  • Observability experience using Prometheus, Grafana, or OpenTelemetry for monitoring, diagnosis, and SLO tracking

  • Experience with production incident response and applying lessons learned

  • Production secrets and certificates management (secure storage, rotation, renewal)

  • Proficiency in Python, Go, or comparable for building/testing/maintaining production tooling and automation

  • Demonstrated ability to use AI coding agents effectively with sound judgment

  • Strong system design and architecture experience, including producing technical design documents

  • Self-motivated, high-ownership mindset; ability to learn and apply new technologies quickly

  • Senior+ only: Track record delivering complex platform or distributed systems across multiple teams, with deep reliability/capacity planning/incident management expertise at organizational scale

  • Senior+ only: Ability to lead technical direction across organizational boundaries and communicate architectural trade-offs to technical and non-technical stakeholders

Benefits

  • Compensation: $180,000 - $260,000 USD annually, with potential annual bonus

  • Enterprise-wide learning and mobility support

  • Flexible work and values-driven environment

  • Additional package details provided during initial screening

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report