Backend AI Engineer

As an Android Software Engineer, you’ll help shape the mobile experience while building backend systems that connect AI models, tools, APIs, and client applications. The work focuses on turning model capabilities into fast, stable, and reliable product experiences.

Responsibilities

• Build and operate backend systems powering AI features in production.
• Design inference pipelines, orchestration layers, and service boundaries around AI models.
• Develop stable, observable APIs used across mobile and desktop clients.
• Work on systems supporting multi-step reasoning, tool use, persistent context, and real-world task completion.
• Optimize latency, throughput, reliability, and cost across inference workflows.
• Implement and improve caching, batching, streaming, and other performance strategies.
• Own production concerns including monitoring, logging, alerting, and incident response.
• Debug distributed systems under load and resolve production issues quickly.
• Collaborate closely with frontend and ML teams to ensure smooth product integration.

Requirements

• Strong backend engineering experience in production environments.
• Experience building high-throughput, low-latency backend services.
• Strong understanding of distributed systems and production-scale architecture.
• Experience designing reliable APIs and service boundaries.
• Familiarity with AI inference patterns, including LLMs, embeddings, and/or multimodal systems.
• Ability to work with non-deterministic model behavior and build reliable systems around it.
• Experience with Python and/or Node.js.
• Experience with SQL and NoSQL databases.
• Practical knowledge of Docker and Kubernetes.
• Bias toward shipping, learning from production behavior, and improving systems iteratively.
• Ability to work independently in a fast-moving, high-ownership environment.

Nice to Have

• Experience working directly with OpenAI, Anthropic, or open-source LLMs.
• Experience with PyTorch.
• Experience building AI agents, orchestration systems, or tool-using AI workflows.
• Experience with streaming APIs, batching, caching, or inference optimization.
• Experience supporting AI-powered products across mobile and desktop clients.
• Experience working on consumer-facing AI products.

What They Offer

• Cash and equity compensation.
• EOR contract.
• Remote-first setup with flexible hours as part of a distributed, global team.
• Company laptop provided.
• A quick hiring process: 3, occasionally 4, interviews, with fast decisions afterwards.