Unlock Full Resume Report

New offer - be the first one to apply!

September 21, 2026

Senior Distinguished AI Engineer (AI Compute Platform)

Senior • Remote

343,400 - 392,000 USD/yr

New York, NY

Quick Facts

  • Role: Senior Distinguished AI Engineer (AI Compute Platform)

  • Focus: AI compute infrastructure for large-scale, real-time and batch workloads

  • Work model: Remote eligible

Description

Architect and build a highly available, multi-tenant, secure machine learning platform by engineering shared compute infrastructure on CPU and GPU substrates. Develop distributed compute engine solutions (Ray and Spark) to accelerate workloads including LLM pre-training, reinforcement learning, inference, and feature generation. Drive operational excellence through automation (KTLO) and lead system design, execution, and technical community impact.

Responsibilities

  • Architect and build control and data plane implementations for a secure, multi-tenant ML platform

  • Develop Ray and Spark distributed compute engine solutions to accelerate LLM and large-scale data processing while optimizing compute unit economics

  • Automate KTLO (Keep The Lights On) workflows to improve operational excellence

  • Direct technical execution across a portfolio covering distributed microservices and foundation model workloads

  • Collaborate cross-functionally with product/program management to optimize business outcomes with strong technical solutions

  • Lead and participate in system design and code review sessions; stay current with technology trends

  • Mentor and grow talent; contribute to building the Distinguished Engineering community

Requirements

  • Bachelor's degree in Computer Science/AI/Electrical Engineering/Computer Engineering (or related) plus 10+ years experience developing AI/ML algorithms or technologies; or Master's degree plus 8+ years

  • 10+ years programming with Python, Go, Scala, or Java

  • Experience building large-scale, highly available, high-performance systems

  • Ability to architect control and data plane implementations for a secure, multi-tenant ML platform

Benefits

  • Comprehensive, competitive benefits package supporting health, financial, and overall well-being (eligibility varies by status and level)

  • Performance-based incentive compensation eligibility, including cash bonus and/or long-term incentives

Similar jobs you might like