Senior HPC DevOps Engineer

Quick Facts

Senior HPC DevOps Engineer responsible for scaling, reliability, and automation of an HPC and machine learning (MLOps) platform.

Description

Lead the scaling, reliability, and automation of an HPC and ML (MLOps) cloud platform. You’ll guide scientists and data teams for self-service workloads, manage AWS GPU capacity, and troubleshoot job scheduling failures, cluster bottlenecks, and quota issues. Maintain automated provisioning/deployment pipelines and deploy GPU-accelerated containerized HPC environments and cloud HPC workloads.

Responsibilities

• Guide scientists and data teams to effectively use the platform UI and run self-service workloads without infrastructure friction.
• Advise on capacity strategy (capacity blocks vs. on-demand usage) to optimize cost, quotas, and resource availability.
• Maintain automated pipelines for infrastructure provisioning and platform service deployments.
• Resolve technical queries around job scheduling failures, cluster bottlenecks, and resource quotas.
• Collaborate with developer experience teams to improve documentation.
• Collaborate with engineering teams to monitor GPU utilization using tools such as CloudWatch or Prometheus.
• Manage AWS GPU instance families and allocate block compute for large-scale ML training and inference pipelines.
• Ensure compute availability through capacity planning and reservation management.
• Deploy containerized environments tuned for HPC and GPU pass-through.
• Deploy and scale HPC workloads on cloud infrastructure using parallel storage and networking solutions.

Requirements

• 5+ years of experience in HPC or DevOps engineering roles.
• Knowledge of MPI and OpenMP.
• Multi-node GPU communication protocols such as NCCL and GPUDirect.
• Experience managing AWS GPU instance families: P-series, G-series, Tranium/Inferentia.
• Hands-on expertise with AWS Capacity Blocks for ML, On-Demand Capacity Reservations (ODCRs), and Service Quota management.
• Experience deploying containerized environments with Apptainer/Singularity, Docker, or Enroot.
• Understanding of I/O performance bottlenecks with distributed file systems such as Lustre, GPFS, BeeGFS, or AWS FSx for Lustre.
• Hands-on profiling skills using NVIDIA Nsight (or similar) to identify memory and compute bottlenecks.
• Experience deploying/scaling cloud HPC workloads with EFA, ParallelCluster, and FSx for Lustre.
• English proficiency at B2+ level.

Benefits

• Hybrid work by design, with opportunity to work remotely within Poland.
• Chance to work abroad up to 60 days annually; business-driven relocation opportunities.
• Career development programs; thought leadership, mentoring, soft skills and well-being programs.
• Certification support (Anthropic, Gemini, GCP, Azure, AWS) and English classes.
• Stable pay; Employee Stock Purchase Plan participation with a 15% discount.
• Benefits package including health insurance, multisport, and shopping vouchers.
• Referral bonuses up to $2,000; office amenities and corporate, social and well-being events.