Software Engineer, Agentic Systems

ServiceNow, Inc.

Mountain View, CA • 1h ago • On-site

Junior

On-site

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

0

Quick Facts

Role: Software Engineer, Agentic Systems (distributed systems engineering)

Focus: Agent runtime infrastructure for orchestrating, executing, and delivering agent responses in real time

Description

Build the runtime infrastructure that powers agentic AI, including orchestration, long-running session management, event-driven messaging, and observability. The role is designed for distributed systems engineering—agents can plan and execute multi-step workflows, call tools, wait for human input, and resume while maintaining correctness, observability, and low latency.

Responsibilities

  • Develop an agent orchestration engine using a state machine for long-running agent sessions across multiple LLM calls and tool invocations
  • Implement distributed session management with lease-based ownership via DynamoDB conditional writes, heartbeat protocols, and checkpointing crash recovery
  • Create an event-driven message pipeline using SQS FIFO queues (ordered delivery), Kafka consumers (event processing), and real-time streaming via gRPC and Socket.IO
  • Apply structured concurrency with Python asyncio TaskGroups to run concurrent per-session tasks with fail-fast semantics and graceful cancellation
  • Build observability infrastructure using OpenTelemetry, including distributed trace context propagation across async boundaries and custom span lifecycle management
  • Design caching and state layers with Redis and DynamoDB KV stores, per-org/per-bot scoping, batch read optimization, and hot-reload configuration

Requirements

  • 0-2+ years building production backend/infrastructure systems
  • Strong in Python or Go (ideally both)
  • Experience designing and operating systems that handle real traffic at scale
  • Deep experience in at least 3 areas: distributed systems; concurrent/async programming; event-driven architectures; infrastructure database systems (DynamoDB/Redis); observability; gRPC/protobuf
  • Comfort with ambiguity for novel problems

Benefits

  • Build runtime infrastructure for agentic AI used by millions of enterprise users in real time
  • Own critical distributed systems components that enable correctness, low latency, and observability

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report