Senior HPC & CUDA Optimization Engineer

Quick Facts

• Role: Senior HPC & CUDA Optimization Engineer

• Focus: CUDA kernel optimization, GPU performance, and multi-GPU/distributed computing

Description

You will design, develop, and optimize CUDA kernels for large-scale scientific and engineering applications. You’ll analyze GPU performance with profiling tools to find and resolve bottlenecks, and implement distributed and multi-GPU solutions using MPI, NCCL, and NVSHMEM. You’ll also build and maintain high-performance C++ and Python code, and debug complex performance and memory issues across GPU architectures and distributed systems.

Responsibilities

• Design, develop, and optimize CUDA kernels

• Profile and improve GPU performance; identify bottlenecks

• Implement and optimize distributed and multi-GPU computing (MPI, NCCL, NVSHMEM)

• Develop and maintain high-performance C++ and Python for performance-critical, high-load systems

• Collaborate to architect scalable, efficient software solutions

• Debug complex performance and memory issues across GPU architectures and distributed systems

• Research and apply HPC, numerical methods, and GPU best practices to improve existing codebases

Requirements

• 5+ years of professional experience with C++ and Python development

• Deep knowledge of CUDA and GPU architecture, including PTX, memory hierarchy, and kernel optimization

• Experience with GPU profiling and performance analysis to identify bottlenecks

• Hands-on experience with distributed and multi-GPU computing using MPI, NCCL, and NVSHMEM

• Experience developing and optimizing performance-critical, high-load software systems

• Strong debugging and software architecture skills

Benefits

• Stable pay

• Employee Stock Purchase Plan with a 15% discount

• Health insurance, multisport, and shopping vouchers

• Referral bonuses up to $2,000

• Hybrid work model with opportunity to work remotely within Poland

• Chance to work abroad for up to 60 days annually and business-driven relocation opportunities

• Career development programs, mentoring, and soft skills/well-being programs

• English classes and certifications (Anthropic, Gemini, GCP, Azure, AWS)

• Office amenities and corporate/social/well-being events