September 6, 2025
Senior Product Manager - Inference Benchmarking
Senior • Hybrid • On-site • Remote
$208,000 - $327,750/yr
Santa Clara, CA
NVIDIA has become the platform upon which every new AI-powered application is built. From healthcare research applications to autonomous vehicles, or voice-recognition systems, there is a need to simplify and deliver predictability for AI applications and workflows ... and NVIDIA is right in the center of this revolution. Businesses are often challenged with balancing the performance and costs of inference workloads. Token economics need to be matched with performance and user experience. NVIDIA technologies simplify model deployment while optimizing cost and performance for AI inference workloads. The role of this product manager is to work across NVIDIA to build the right kind of benchmarks, products, and tools that can help customers understand true performance & TCO of Inference.
What you will be doing:
Serve as a Subject Matter Expert on AI Inference: Maintain a deep understanding of the entire inference stack, including performance, scaling across workloads, and emerging technologies like disaggregated serving, to guide technical and product strategy.
Drive Product Strategy through Market and User Insights: Steer product evolution and partnership direction by conducting thorough research on market trends, competitor activities, and customer feedback, translating these insights into actionable development plans and innovative ideas.
Lead Partner Collaboration and Project Execution: Actively manage external partnerships by leading project planning, defining specific tasks and deliverables, serving as the primary liaison for communication, and educating partners on product value to ensure alignment and swift issue resolution.
Spearhead Cross-Functional Product Introduction: Drive the new product introduction and transition processes by collaborating seamlessly with engineering, design, operations, sales, and marketing teams, ensuring a unified approach from conception to launch.
Enhance Product and User Experience: Play a key role in the product development lifecycle by contributing to the ideation, design, and testing of user experiences, ensuring the final product meets and exceeds customer and partner expectations.
What we need to see:
BS or MS in Computer Science, Computer Engineering, or a related team (or equivalent experience)
12+ years of product‑management experience in enterprise technology.
Be a subject matter expert on Inference. Understand different components of the inference stack, how they perform, scale, and correlate to workloads.
Ability to articulate trade‑offs among latency, throughput, cost, and reliability to both engineering and executive audiences.
Strong cross‑functional execution: writes clear specs and PRDs, produces GTM collateral, and leads agile processes.
Ways to stand out from the crowd:
Masters/PhD or Expertise in distributed systems or Demonstrated experience in Inference.
Experience with Inference (within the stack or ecosystem) and integrating with enterprise platforms; deployments at modern data‑center scale;
We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our elite engineering teams are growing fast. NVIDIA is widely considered to be one of the industry's most desirable employers. NVIDIA is at the center of Deep Learning, Artificial Intelligence, and Autonomous Vehicles. If you're looking for a challenge, thrives in an ambiguous environment and shares our passion for technology, we want to hear from you. We are looking for great people to help us accelerate the next wave of artificial intelligence.
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 208,000 USD - 327,750 USD.You will also be eligible for equity and benefits.
