Principal Machine Learning Engineer (AI)

Next Step Systems

15m ago • Remote

Senior

Remote

170,000 - 200,000 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for Principal Machine Learning Engineer (AI) role

Improve your resume now

$170,000 – $200,000/year

Quick Facts

  • Role: Principal Machine Learning Engineer (AI)

  • Work model: 100% remote (U.S. only)

  • Assessment: 60-minute coding assessment

Description

You will be a deep technical authority designing and evolving critical ML systems end-to-end across training, evaluation, inference, and deployment. The role focuses on hands-on architecture and performance, including GPU-optimized training pipelines and scalable, low-latency inference systems. You will own production deployment quality under real constraints such as latency, cost, reliability, and safety.

Responsibilities

  • Architect and build large-scale ML systems across data, training, evaluation, inference, and deployment

  • Design reproducible, high-performance GPU training pipelines

  • Architect inference systems balancing latency, throughput, cost, and reliability

  • Design and maintain data systems for high-quality synthetic and real-world training data

  • Implement evaluation pipelines for performance, robustness, safety, and bias

  • Own production deployment with GPU optimization, memory efficiency, latency reduction, and scaling

  • Collaborate with application engineering to integrate ML into backend and products (mobile/desktop)

  • Make pragmatic trade-offs and ship improvements quickly from real usage

Requirements

  • Proven U.S. residency; must be able to demonstrate eligibility

  • Willingness to take a 60-minute coding assessment

  • Strong deep learning background with transformer-based architectures

  • AI experience

  • Hands-on training, fine-tuning, or production deployment of large-scale ML models

  • Proficiency in at least one ML framework (PyTorch or JAX)

  • Experience with distributed training/inference (e.g., DeepSpeed, FSDP, Megatron, ZeRO, Ray)

  • Strong software engineering fundamentals for robust, maintainable, production-grade systems

  • GPU optimization experience (memory efficiency, quantization, mixed precision)

  • Comfort owning ambiguous, zero-to-one ML systems end-to-end

  • Bias toward shipping, learning fast, and iterative improvement

  • Experience with LLM inference frameworks (vLLM, TensorRT-LLM, FasterTransformer)

  • Contributions to open-source ML or systems libraries (preferred)

  • Background in scientific computing, compilers, or GPU kernels (preferred)

  • Experience with RLHF pipelines (PPO, DPO, ORPO) (preferred)

  • Experience with multimodal or diffusion models (preferred)

  • Experience with large-scale data processing (Apache Arrow, Spark, Ray) (preferred)

Benefits

  • Medical insurance, dental, vision

  • Savings plan options

  • PTO

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report