Senior Software Engineer

Quick Facts

• Role: Senior Software Engineer (Evaluation Engineering / AI systems)

• Work mode: 100% remote

• Compensation: $208,000—$315,000 USD

Description

Build and operate large-scale systems that power AI workloads and post-training/benchmark evaluation datasets for foundation models. You will develop distributed compute, data management, and data engineering workflow systems, and prototype scalable back-end services for new foundation model development tools. The role focuses on productionizing agentic long-running reasoning and verification tasks using modern evaluation and orchestration approaches.

Responsibilities

• Own architecture, design, development, and operations of large-scale AI/ML systems (distributed compute, data management, data engineering workflows, and end-user experiences)

• Integrate the latest agentic and foundation model technologies to improve evaluation workflows

• Prototype, optimize, and maintain scalable back-end services for foundation model development tools

• Design extensible, testable interfaces between internal services, storage, and underlying data models

• Work cross-functionally with engineers, product managers, and field team members

Requirements

• Bachelor’s degree (or foreign equivalent) in Computer Science or related field

• 4+ years developing software using Java and TypeScript with relational databases (scalability, reliability, performance)

• 4+ years building and optimizing large-scale distributed systems or compute frameworks for data processing

• 3+ years building AI/ML systems and services in production for cloud-native applications, including AI agents and LLM-powered systems (RAG, MCP)

• 3+ years designing and implementing data storage, compute, and retrieval systems for AI/ML applications

• 3+ years improving LLM applications via evaluation frameworks, prompt engineering, and agent orchestration

• 3+ years leading or owning large multi-person engineering projects from design through deployment

• Must be able to work 100% remotely

Benefits

• Opportunity to shape priorities and initiatives and influence strategic decisions

• Support for growth, learning, and career development

• Equal Employment Opportunity and reasonable accommodations for applicants with disabilities