Senior Software Engineer, Recipe Pathfinding

NVIDIA is seeking a Senior Software Engineer to discover and innovate new low-precision and sparsity recipes in the pretraining setting. A recipe defines which operators in an LLM are transformed into low-precision and/or sparsified variants, thereby unlocking efficiency gains. Recipes can be statically defined at model load time or dynamically adapting to a layer’s input distribution. Recipes can incorporate and compose algorithmic techniques like rotations or low-rank decompositions to tame aggressors like outliers. We are a team committed to developing next-generation SW to make use of novel HW features on current and next-gen GPUs. The scope spans all phases of the LLM life cycle: pre training, post training, and generation. This is a coding-heavy role focused on infrastructure, data, tooling, and performance. Your work will directly support NVIDIA's internal SW systems for supporting recipe prototyping. Your work is a component of our SW productization story in libraries like Megatron-LM and Transformer Engine.

What you'll be doing:

• Create well-designed and well-tested SW systems and PoCs to support recipe exploration for research settings

• Analyze and prototype state-of-the-art methods for quantization and sparsity

• Benchmark, profile, and optimize LLM workloads in cluster settings

• Develop new data analysis tools and visualizations to aid in numerics debugging

• Keep developer and researcher productivity and efficiency high by removing obstacles (e.g., slow CI systems, slow training systems)

• Participate in code reviews, address code review feedback if applicable.

What we need to see:

• An MS or PhD or equivalent experience in Computer Science or a related field, and 5+ years of relevant software engineering experience.

• Proficient in Python

• Experience with PyTorch or similar framework

• Strong Software Engineering background with a focus on building concise and well-tested code

• Experience working with ML accelerators, performance optimization and debugging

• Strong written and oral communication skills

Ways to stand out from the crowd:

• Proficient in precision and numerics for ML

• Familiarity with C++ and CUDA

• Strong foundation in LLM pre training, post training, or generation ​

The GPU started out as the engine for simulating human imagination, conjuring up the amazing virtual worlds of video games and Hollywood films. Now, NVIDIA’s GPU runs deep learning algorithms, simulating human intelligence, and acts as the brain of computers, robots and self-driving cars that can perceive and understand the world. Just as human imagination and intelligence are linked, computer graphics and artificial intelligence come together in our architecture. Today, NVIDIA GPUs are used broadly for deep learning, and NVIDIA is increasingly known as “the AI computing company.”

Widely considered to be one of the technology world’s most desirable employers, NVIDIA has some of the most forward-thinking and hardworking people in the world inventing the future for us. Are you a creative and collaborative software engineer seeking new challenges? If so, we want to hear from you! Come, join us and help build the real-time, cost-effective AI computing platform driving our success in this exciting and quickly growing field.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.Applications for this job will be accepted at least until August 31, 2025.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.