Senior Staff Software Engineer, Agentic Systems

Quick Facts

Senior Staff Software Engineer, Agentic Systems. Build the distributed runtime infrastructure powering AI agents that handle real-time enterprise user interactions.

Description

This is a distributed systems engineering role focused on agentic AI runtime infrastructure—not an ML role. You will build systems that support long-running agent sessions, tool use, human-in-the-loop interactions, correctness, observability, and low latency.

Responsibilities

• Build an agent orchestration engine: a state machine that manages long-running agent sessions across multiple LLM calls and tool invocations.
• Implement distributed session management: lease-based ownership using DynamoDB conditional writes, heartbeat protocols, and crash recovery via checkpointing.
• Create an event-driven message pipeline: SQS FIFO for ordered delivery, Kafka consumers for event processing, and real-time streaming via gRPC and Socket.IO.
• Apply structured concurrency with Python asyncio TaskGroups for concurrent per-session tasks, including fail-fast semantics and graceful cancellation.
• Develop observability infrastructure using OpenTelemetry, distributed trace context propagation across async boundaries, and custom span lifecycle management.
• Design caching and state layers: Redis and DynamoDB KV stores with per-org/per-bot scoping, batch read optimization, and hot-reload configuration.

Requirements

• 10+ years building production backend/infrastructure systems.
• Strong in Python or Go (ideally both).
• Deep experience in at least 3 of: distributed systems, concurrent/async programming, event-driven architectures, database systems for infrastructure, observability, gRPC/protobuf.
• Experience designing and operating systems that handle real traffic at scale.
• Comfort with ambiguity and novel, unscripted problem solving.

Benefits

• Base pay guideline of $201,300–$352,300 plus equity (when applicable) and variable/incentive compensation.
• Health plans (including flexible spending accounts), 401(k) with match, ESPP, matching donations, flexible time away, and family leave programs.