
Infrastructure Software Engineer
Epiq
New York, NY • 1h ago • On-site
Senior
On-site
180,000 - 260,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Infrastructure Software Engineer role
Improve your resume now
$180,000 – $260,000/year
Quick Facts
Role: Infrastructure Software Engineer
Focus: Cloud infrastructure and automation for an AI platform (IaaC, Kubernetes, CI/CD, networking, secrets, observability)
Description
Build and operate the cloud infrastructure and automation behind an AI platform, including Infrastructure as Code, Kubernetes, CI/CD, networking, secrets, and observability across Azure, AWS, and on-prem GPU environments. You will own infrastructure reliability, scalability, and security and partner with backend, AI, product, and security teams to standardize deployment, observability, and security patterns. Responsibilities include Terraform module development, production Kubernetes operations, progressive delivery for zero-downtime rollouts, GPU infrastructure operations, SLOs and compliance infrastructure, and on-call incident response.
Responsibilities
Write, test, review, and maintain reusable Terraform modules and infrastructure automation for provisioning, environment configuration, and drift detection/remediation
Operate production Kubernetes: orchestration, autoscaling, resource governance, network policy, and cluster lifecycle management
Build and maintain CI/CD and GitOps release automation with progressive delivery, safe rollback, and protection of in-flight requests and long-running jobs
Operate cloud and on-prem GPU infrastructure for model-serving reliability, cluster management and scheduling, utilization/cost, and observability
Define platform SLOs and implement metrics, tracing, alerting, and error-budget practices
Implement security and compliance infrastructure including hardening, audit logging, data-residency controls, retention, legal hold, and audit evidence collection
Build and maintain network, secrets/key/credential, TLS, and certificate-lifecycle infrastructure
Use AI coding agents while owning outcomes (design/specs/test plans, code review, and verification of correctness, security, and maintainability) and ship major changes behind automated tests and controlled rollouts
Build and maintain AI-native developer tooling and technical design documentation; contribute to architectural reviews
Participate in on-call rotation and incident response; maintain runbooks and backup/restore procedures; convert incident findings into lasting fixes
Senior+ only: Define foundational infrastructure architecture and patterns; lead migrations/modernization/capacity planning while protecting production availability
Senior+ only: Raise the engineering bar through reusable platform primitives, mentoring, and cross-team technical leadership while staying hands-on
Requirements
3+ years of professional experience in infrastructure engineering, platform engineering, or site reliability engineering
Production experience operating systems with on-call responsibility
Hands-on experience with AWS, Google Cloud Platform, or Azure
Infrastructure as code with Terraform, including reusable module design
Production Kubernetes experience (scaling, upgrades, resource limits, network policy, troubleshooting)
CI/CD pipeline ownership using GitHub Actions, Azure DevOps, or comparable platforms
Observability experience using Prometheus, Grafana, or OpenTelemetry for monitoring, diagnosis, and SLO tracking
Experience with production incident response and applying lessons learned
Production secrets and certificates management (secure storage, rotation, renewal)
Proficiency in Python, Go, or comparable for building/testing/maintaining production tooling and automation
Demonstrated ability to use AI coding agents effectively with sound judgment
Strong system design and architecture experience, including producing technical design documents
Self-motivated, high-ownership mindset; ability to learn and apply new technologies quickly
Senior+ only: Track record delivering complex platform or distributed systems across multiple teams, with deep reliability/capacity planning/incident management expertise at organizational scale
Senior+ only: Ability to lead technical direction across organizational boundaries and communicate architectural trade-offs to technical and non-technical stakeholders
Benefits
Compensation: $180,000 - $260,000 USD annually, with potential annual bonus
Enterprise-wide learning and mobility support
Flexible work and values-driven environment
Additional package details provided during initial screening
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Senior Software Engineer (Cloud Platform)
UnitedHealth Group
Senior
Technology
Eden Prairie, MN · On-site
$92K - $164K/yr
6 days ago

Senior Infrastructure Automation Engineer
EPAM Systems
Senior
Technology
Poznań, Pl-30, Poland · On-site
N/A
9 days ago
Senior Platform Engineer - Infrastructure
RHAELM
Senior
Technology
Wrocław, DW, Poland · On-site
22K zł - 39K zł/yr
6 days ago

Senior Infrastructure Automation Engineer
EPAM Systems
Senior
Technology
Katowice, SL, Poland · On-site
N/A
9 days ago

Senior Infrastructure Automation Engineer
EPAM Systems
Senior
Technology
Lodz, Ldz, Poland · On-site
N/A
9 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Lead Azure Cloud Engineer
EPAM Systems
Senior
Technology
Poznań, Pl-15, Poland · Remote
N/A
9 days ago

Software Engineer II, Cloud Infrastructure
Remitly
Senior
Technology
Kraków, MA, Poland · On-site
20K zł - 23K zł/yr
6 days ago

Senior Infrastructure Automation Engineer
EPAM Systems
Senior
Technology
Warsaw, MA, Poland · On-site
N/A
9 days ago

AI Platform Engineer
TQLO SP. Z O.O.
Mid
Technology
Warsaw, Maz, Poland · Remote
0K zł - 0K zł/yr
7 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights
