Senior HPC / CUDA Optimization Engineer

EPAM Systems

Krakow, MA, Poland • 41m ago • Remote

Senior

Remote

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Quick Facts

  • Role: Senior HPC / CUDA Optimization Engineer

Description

Design, develop, and optimize CUDA kernels and performance-critical HPC software for large-scale scientific and engineering applications. You will profile GPU and distributed performance, improve kernel efficiency and memory behavior, and build scalable multi-GPU solutions using MPI, NCCL, and NVSHMEM. The role also includes debugging complex GPU and distributed issues and applying HPC and numerical best practices to existing codebases.

Responsibilities

  • Design, develop, and optimize CUDA kernels for large-scale scientific and engineering applications
  • Analyze and improve GPU performance using profiling tools to identify and resolve bottlenecks
  • Implement and optimize distributed and multi-GPU computing solutions using MPI, NCCL, and NVSHMEM
  • Develop and maintain high-performance C++ and Python code for performance-critical, high-load systems
  • Collaborate with cross-functional teams to architect scalable and efficient software solutions
  • Debug complex performance and memory issues across GPU architectures and distributed systems
  • Research and apply best practices in HPC, numerical methods, and GPU computing to improve existing codebases

Requirements

  • 5+ years of professional experience with C++ and Python development
  • Deep knowledge of CUDA, GPU architecture, PTX, memory hierarchy, and kernel optimization
  • Experience with GPU profiling, performance analysis, and bottleneck identification
  • Hands-on experience with distributed and multi-GPU computing (MPI, NCCL, NVSHMEM)
  • Experience developing and optimizing performance-critical, high-load software systems
  • Strong debugging and software architecture skills

Benefits

  • Hybrid by design mode with the opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Career development programs; thought leadership, mentoring, soft skills and well-being programs
  • Certification support (Anthropic, Gemini, GCP, Azure, AWS)
  • English classes
  • Stable pay
  • Employee Stock Purchase Plan with a 15% discount
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Referral bonuses up to $2,000
  • Offices with entertainment and relaxation zones (table tennis and football, free snacks, coffee, etc.)
  • Corporate, social and well-being events
  • Note: Benefits listed apply to employees only; B2B contractor cooperation terms are agreed individually

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report