Senior HPC / CUDA Optimization Engineer

Quick Facts

• Senior HPC / CUDA Optimization Engineer

Description

Join as a Senior HPC / CUDA Optimization Engineer to design, develop, and optimize CUDA kernels for large-scale scientific and engineering workloads. You will profile GPU performance, optimize memory and execution bottlenecks, and build scalable multi-GPU/distributed solutions using MPI, NCCL, and NVSHMEM. The role also includes maintaining high-performance C++ and Python code and debugging complex performance issues across GPU and distributed systems.

Responsibilities

• Design, develop, and optimize CUDA kernels for large-scale scientific and engineering applications
• Analyze and improve GPU performance using profiling tools to identify and resolve bottlenecks
• Implement and optimize distributed and multi-GPU computing solutions using MPI, NCCL, and NVSHMEM
• Develop and maintain high-performance C++ and Python code for performance-critical, high-load systems
• Collaborate with cross-functional teams to architect scalable and efficient software solutions
• Debug complex performance and memory issues across GPU architectures and distributed systems
• Research and apply best practices in HPC, numerical methods, and GPU computing to improve existing codebases

Requirements

• 5+ years of professional experience with C++ and Python development
• Deep knowledge of CUDA, GPU architecture, PTX, memory hierarchy, and kernel optimization
• Experience with GPU profiling, performance analysis, and bottleneck identification
• Hands-on experience with distributed and multi-GPU computing (MPI, NCCL, NVSHMEM)
• Experience developing and optimizing performance-critical, high-load software systems
• Strong debugging and software architecture skills

Benefits

• Hybrid work model with opportunity to work remotely within Poland
• Chance to work abroad up to 60 days annually
• Career development programs and mentoring
• Thought leadership, soft skills, and well-being programs
• Certifications (Anthropic, Gemini, GCP, Azure, AWS)
• English classes
• Stable pay
• Employee Stock Purchase Plan with 15% discount
• Benefits package (health insurance, multisport, shopping vouchers)
• Referral bonuses up to $2,000
• Office perks and events (entertainment/relaxation zones, snacks, coffee, social and well-being events)
• Options for Contractor (B2B) cooperation with terms agreed individually