Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights
New offer - be the first one to apply!
September 21, 2026
Senior Distinguished AI Engineer (AI Compute Platform)
Senior • Remote
343,400 - 392,000 USD/yr
New York, NY
Apply now
Quick Facts
Role: Senior Distinguished AI Engineer (AI Compute Platform)
Focus: AI compute infrastructure for large-scale, real-time and batch workloads
Work model: Remote eligible
Description
Architect and build a highly available, multi-tenant, secure machine learning platform by engineering shared compute infrastructure on CPU and GPU substrates. Develop distributed compute engine solutions (Ray and Spark) to accelerate workloads including LLM pre-training, reinforcement learning, inference, and feature generation. Drive operational excellence through automation (KTLO) and lead system design, execution, and technical community impact.
Responsibilities
Architect and build control and data plane implementations for a secure, multi-tenant ML platform
Develop Ray and Spark distributed compute engine solutions to accelerate LLM and large-scale data processing while optimizing compute unit economics
Automate KTLO (Keep The Lights On) workflows to improve operational excellence
Direct technical execution across a portfolio covering distributed microservices and foundation model workloads
Collaborate cross-functionally with product/program management to optimize business outcomes with strong technical solutions
Lead and participate in system design and code review sessions; stay current with technology trends
Mentor and grow talent; contribute to building the Distinguished Engineering community
Requirements
Bachelor's degree in Computer Science/AI/Electrical Engineering/Computer Engineering (or related) plus 10+ years experience developing AI/ML algorithms or technologies; or Master's degree plus 8+ years
10+ years programming with Python, Go, Scala, or Java
Experience building large-scale, highly available, high-performance systems
Ability to architect control and data plane implementations for a secure, multi-tenant ML platform
Benefits
Comprehensive, competitive benefits package supporting health, financial, and overall well-being (eligibility varies by status and level)
Performance-based incentive compensation eligibility, including cash bonus and/or long-term incentives
Similar jobs you might like

Senior Platform Software Engineer, AI Acceleration, Developer Tools
Oracle
Senior
Technology
Remote
$93K - $210K/yr
3 days ago

Senior Software Engineer
Pearson
Senior
Technology
Montgomery, AL
$135K - $155K/yr
4 days ago

Senior Machine Learning Engineer
Intuit
Senior
Technology
San Diego, CA
$171K - $232K/yr
5 days ago

Senior Platform Engineer
EPAM Systems
Senior
Technology
Gdańsk, Poland · Remote
N/A
3 days ago

Senior Platform Engineer
EPAM Systems
Senior
Technology
Warsaw, Poland · Remote
N/A
3 days ago

Senior Platform Engineer
EPAM Systems
Senior
Technology
Krakow, Poland · Remote
N/A
3 days ago

Senior Platform Engineer
EPAM Systems
Senior
Technology
Lodz, Poland · Remote
N/A
3 days ago

Senior Platform Engineer
EPAM Systems
Senior
Technology
Wrocław, DS, Poland · Remote
N/A
3 days ago
Senior Data Scientist / Machine Learning Engineer
Addepto
Senior
Technology
Warsaw, Poland · Remote
19K zł - 25K zł/yr
2 days ago

Senior Platform Engineer
EPAM Systems
Senior
Technology
Katowice, SL, Poland · Remote
N/A
3 days ago
