
Software Engineer, Agentic Systems
ServiceNow, Inc.
Mountain View, CA • 1h ago • On-site
Junior
On-site
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Quick Facts
Role: Software Engineer, Agentic Systems (distributed systems engineering)
Focus: Agent runtime infrastructure for orchestrating, executing, and delivering agent responses in real time
Description
Build the runtime infrastructure that powers agentic AI, including orchestration, long-running session management, event-driven messaging, and observability. The role is designed for distributed systems engineering—agents can plan and execute multi-step workflows, call tools, wait for human input, and resume while maintaining correctness, observability, and low latency.
Responsibilities
- Develop an agent orchestration engine using a state machine for long-running agent sessions across multiple LLM calls and tool invocations
- Implement distributed session management with lease-based ownership via DynamoDB conditional writes, heartbeat protocols, and checkpointing crash recovery
- Create an event-driven message pipeline using SQS FIFO queues (ordered delivery), Kafka consumers (event processing), and real-time streaming via gRPC and Socket.IO
- Apply structured concurrency with Python asyncio TaskGroups to run concurrent per-session tasks with fail-fast semantics and graceful cancellation
- Build observability infrastructure using OpenTelemetry, including distributed trace context propagation across async boundaries and custom span lifecycle management
- Design caching and state layers with Redis and DynamoDB KV stores, per-org/per-bot scoping, batch read optimization, and hot-reload configuration
Requirements
- 0-2+ years building production backend/infrastructure systems
- Strong in Python or Go (ideally both)
- Experience designing and operating systems that handle real traffic at scale
- Deep experience in at least 3 areas: distributed systems; concurrent/async programming; event-driven architectures; infrastructure database systems (DynamoDB/Redis); observability; gRPC/protobuf
- Comfort with ambiguity for novel problems
Benefits
- Build runtime infrastructure for agentic AI used by millions of enterprise users in real time
- Own critical distributed systems components that enable correctness, low latency, and observability
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Software Engineer, Agentic Systems
ServiceNow
Junior
Technology
Mountain View, CA · On-site
N/A
1 days ago

Senior Staff Software Engineer, Agentic Systems
ServiceNow
Senior
Technology
Mountain View, CA · On-site
$201k - $352k/yr
7 days ago

Senior Software Engineer, Agentic Platform
ServiceNow, Inc.
Senior
Technology
Mountain View, CA, United States of America · On-site
$161k - $274k/yr
4 days ago

Senior Software Engineer, Agentic Platform
ServiceNow, Inc.
Senior
Technology
Mountain View, CA · On-site
N/A
12 days ago

Agentic AI Engineer
SumasEdge Corporation
Senior
Technology
Remote
N/A
8 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior Software Engineer, Agentic Platform
ServiceNow
Senior
Technology
Mountain View, CA · On-site
$161k - $274k/yr
5 days ago

Senior Software Engineer (Data and Platform Tools)
Bloomberg L.P.
Senior
Technology
New York, NY · On-site
$160k - $240k/yr
7 days ago

Senior Staff Machine Learning Engineer, Agentic Systems
ServiceNow, Inc.
Senior
Technology
Mountain View, CA · On-site
$201k - $352k/yr
12 days ago

Software Engineer III - Applied AI
JPMorgan Chase & Co.
Senior
Technology
Jersey City, NJ · On-site
N/A
5 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights