New offer - be the first one to apply!

July 29, 2025

Engineering Manager - Rack Scale AI Systems

Senior • On-site

$168,000 - $270,250/yr

Santa Clara, CA

NVIDIA is looking for an Engineering Manager to Lead IPP's (Infrastructure, Planning and Process) Cloud Platform Team focused on Rack Scale AI Systems. IPP is a global organization within NVIDIA. This group works with various other groups within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on thousands of servers helping with the productivity of thousands of NVIDIA's software engineers worldwide. The cloud hosts a heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), a multitude of hardware platforms both NVIDIA GPUs and Tegra Processors. Are you passionate about distributed infrastructure and looking for sophisticated, critical issues, ready to build the next generation of cloud services, design creative solutions, mine through data to uncover real problems and fix them? We are excited to onboard a fun-loving person like you.

What you'll be doing:

  • Build and Lead an engineering organization focused on Rack Scale systems onboarding and Bring up execution along with external and internal partner engagement.

  • Work with Engineering, Product Management, and Customer Program Management teams to define, prioritize, and implement features, infrastructure, processes, and workflows.

  • Work with NVIDIA Product Teams to understand new product requirements including HPC and AI/ML Products.

  • Collaborate with multi-functional teams, including system engineering, software engineering, mechanical/thermal engineering, operations, data center teams, external vendors, and other partners to successfully deliver a reliable and robust platform from concept to prototype to deployments.

  • Help identify potential or observed weaknesses in the current process, offer ideas for actions that can improve quality.

  • Drive overall quality of deployments and improve time to market next gen products

  • Lead the on-ground team in collecting data on SOL deployments, physical touch information, and patterns of failure.

  • Drive overall triage and recovery execution during product bring up and maintain support through product sustaining phase.

What we need to see:

  • Bachelor's or Master's Degree in Computer Science or Software Engineering, or equivalent experience.

  • 5+ years of Management experience in large, cross-matrix, and geo-dispersed technology organizations focused in/around the server and data center space—strong experiences in Operations Product Engineering with 8+ years of overall experience.

  • Strong technical skills and understanding of embedded systems, orchestration & automation systems, data centers and cloud architecture, as well as excellent communication and planning skills.

  • Deep understanding of cloud design in the areas of virtualization and global infrastructure, distributed systems, load balancing and security

  • Excellent thought process for identifying risks and developing robust mitigations

  • Strong collaborative and interpersonal skills, specifically a proven track record to effectively guide and influence within a diverse team

Ways to stand out from the crowd:

  • Experience in large scale QA environments, for product bring ups.

  • Experience with high performance or large scale computing environments, parallel computing, or CUDA.

  • Special skills in large-scale computing and cluster computing(MPI), data center design include high speed interconnect InfiniBand, Cluster Storage and Scheduling related design and/or management experience.

  • Experience with converged and hyper-converged hardware and servers.

  • Strong background on Windows & Linux administration.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens new universes to explore, enables outstanding creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence. Widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and passionate about new technologies we want you on our team!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 270,250 USD for Level 2, and 208,000 USD - 333,500 USD for Level 3.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 1, 2025.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.