
Principal Machine Learning Engineer (AI)
Next Step Systems
15m ago • Remote
Senior
Remote
170,000 - 200,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Principal Machine Learning Engineer (AI) role
Improve your resume now
$170,000 – $200,000/year
Quick Facts
Role: Principal Machine Learning Engineer (AI)
Work model: 100% remote (U.S. only)
Assessment: 60-minute coding assessment
Description
You will be a deep technical authority designing and evolving critical ML systems end-to-end across training, evaluation, inference, and deployment. The role focuses on hands-on architecture and performance, including GPU-optimized training pipelines and scalable, low-latency inference systems. You will own production deployment quality under real constraints such as latency, cost, reliability, and safety.
Responsibilities
Architect and build large-scale ML systems across data, training, evaluation, inference, and deployment
Design reproducible, high-performance GPU training pipelines
Architect inference systems balancing latency, throughput, cost, and reliability
Design and maintain data systems for high-quality synthetic and real-world training data
Implement evaluation pipelines for performance, robustness, safety, and bias
Own production deployment with GPU optimization, memory efficiency, latency reduction, and scaling
Collaborate with application engineering to integrate ML into backend and products (mobile/desktop)
Make pragmatic trade-offs and ship improvements quickly from real usage
Requirements
Proven U.S. residency; must be able to demonstrate eligibility
Willingness to take a 60-minute coding assessment
Strong deep learning background with transformer-based architectures
AI experience
Hands-on training, fine-tuning, or production deployment of large-scale ML models
Proficiency in at least one ML framework (PyTorch or JAX)
Experience with distributed training/inference (e.g., DeepSpeed, FSDP, Megatron, ZeRO, Ray)
Strong software engineering fundamentals for robust, maintainable, production-grade systems
GPU optimization experience (memory efficiency, quantization, mixed precision)
Comfort owning ambiguous, zero-to-one ML systems end-to-end
Bias toward shipping, learning fast, and iterative improvement
Experience with LLM inference frameworks (vLLM, TensorRT-LLM, FasterTransformer)
Contributions to open-source ML or systems libraries (preferred)
Background in scientific computing, compilers, or GPU kernels (preferred)
Experience with RLHF pipelines (PPO, DPO, ORPO) (preferred)
Experience with multimodal or diffusion models (preferred)
Experience with large-scale data processing (Apache Arrow, Spark, Ray) (preferred)
Benefits
Medical insurance, dental, vision
Savings plan options
PTO
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Principal Machine Learning Engineer (Agentic AI for Cloud Security)
PaloAlto Networks
Senior
Technology
CA, United States of America · On-site
$163k - $264k/yr
4 days ago
Principal Software Engineer, AI Frameworks
Microsoft
Senior
Technology
Remote
$143k - $275k/yr
23h ago

Machine Learning Technical Lead (AI)
Next Step Systems
Senior
Technology
Remote
$190k - $225k/yr
16m ago

Lead Machine Learning Engineer (AI Systems)
Yard Corporate
Senior
Technology
Warsaw, Pl-Mz, Poland · Remote
42k zł - 58k zł/yr
10 days ago

Principal Machine Learning Engineer
CVS Health
Senior
Technology
New York, NY · On-site
$144k - $288k/yr
6 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Principal Machine Learning Engineer, Vision AI
Toast
Senior
Technology
New York, NY · On-site
$230k - $368k/yr
2 days ago

Principal AI Full Stack Engineer
Digipulse Technologies, Inc
Senior
Technology
Covington, KY · Hybrid
N/A
11 days ago
Senior/Principal Software Engineer (AI Performance)
Microsoft
Senior
Technology
Remote
N/A
6 days ago

AI Architect (Principal) - AI Foundation
FedEx Office
Senior
Technology
Memphis, TN · On-site
$107k - $144k/yr
11 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights