Senior Software Engineer Lead (AI Inference Platform)

Quick Facts

• Role: Senior Software Engineer Lead (AI Inference Platform)

Description

Lead the design and implementation of critical platform components for a global AI inference platform. You will drive technical decisions across APIs, Kubernetes-based orchestration, observability, and deployment models to deliver secure, scalable, and reliable inference services. You’ll also design platform capabilities such as authentication, load balancing, rate limiting, firewall integration, and externally facing API patterns.

Responsibilities

• Lead the design and implementation of critical platform components for an AI inference platform, ensuring performance, scalability, and reliability

• Drive technical decisions for your domain, including tools, frameworks, and architectural approaches

• Evolve platform capabilities: authentication, load balancing, rate limiting, firewall integration, and externally facing API patterns

• Design and improve data plane APIs, including OpenAI-compatible interfaces

• Define and advance observability (metrics, logging, tracing, monitoring, operational diagnostics)

• Drive capacity planning and scalability strategies for traffic, model, and regional growth

• Lead Kubernetes-based orchestration patterns for containerized workloads

• Mentor engineers via code reviews, design discussions, and technical problem-solving

Requirements

• 8+ years of software engineering experience

• Advanced expertise in distributed systems, cloud services, and platform engineering

• Deep experience with internet-facing platform services (API gateways, ingress layers, reverse proxies)

• Advanced cloud-native architecture experience with containerization and Kubernetes

• Proven experience building scalable, high-performance systems using modern DevOps practices, CI/CD pipelines, and infrastructure-as-code

• Technical leadership demonstrated through code quality practices and delivering solutions to complex platform challenges

• Experience designing and operating API platforms (authentication, authorization, traffic management, service protection)

• Extensive observability, monitoring, alerting, and debugging experience for large-scale distributed systems

• Experience with capacity planning, performance analysis, and reliability engineering

Benefits

• FlexBase flexible working program: 95% of employees can choose to work from home, office, or both (based on the advertised country)

• Benefits package covering health, finances, family, and personal time