Senior HPC / CUDA Optimization Engineer

EPAM Systems

Łódź, Poland • 41m ago • Remote

Senior

Remote

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Quick Facts

  • Role: Senior HPC / CUDA Optimization Engineer

Description

Join as a Senior HPC / CUDA Optimization Engineer to design, develop, and optimize CUDA kernels for large-scale scientific and engineering workloads. You will profile and improve GPU performance, and build distributed multi-GPU solutions using MPI, NCCL, and NVSHMEM while maintaining high-performance C++ and Python code. The role includes debugging complex performance and memory issues across GPU architectures and distributed systems.

Responsibilities

  • Design, develop, and optimize CUDA kernels for large-scale scientific and engineering applications
  • Analyze and improve GPU performance using profiling tools to identify and resolve bottlenecks
  • Implement and optimize distributed and multi-GPU computing solutions using MPI, NCCL, and NVSHMEM
  • Develop and maintain high-performance C++ and Python code for performance-critical, high-load systems
  • Collaborate with cross-functional teams to architect scalable and efficient software solutions
  • Debug complex performance and memory issues across GPU architectures and distributed systems
  • Research and apply best practices in HPC, numerical methods, and GPU computing to improve existing codebases

Requirements

  • 5+ years of professional experience with C++ and Python development
  • Deep knowledge of CUDA, GPU architecture, PTX, memory hierarchy, and kernel optimization
  • Experience with GPU profiling, performance analysis, and bottleneck identification
  • Hands-on experience with distributed and multi-GPU computing (MPI, NCCL, NVSHMEM)
  • Experience developing and optimizing performance-critical, high-load software systems
  • Strong debugging and software architecture skills

Benefits

  • Career development programs
  • Thought leadership, mentoring, soft skills and well-being programs
  • Certification programs (Anthropic, Gemini, GCP, Azure, AWS)
  • English classes
  • Stable pay
  • Employee Stock Purchase Plan with a 15% discount
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Referral bonuses up to $2,000
  • Hybrid work by design with opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Business-driven relocation opportunities
  • Company events and well-being activities

Note

  • Open to working with contractors under individually agreed B2B terms; benefits are for employees only.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report