
Senior Software Engineer, Agentic Platform
ServiceNow, Inc.
Mountain View, CA, United States of America • 15m ago • On-site
Senior
On-site
161,300 - 274,200 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Senior Software Engineer, Agentic Platform role
Improve your resume now
$161,300 – $274,200/year
Quick Facts
Role: Senior Software Engineer (Agentic Platform / AI agent runtime infrastructure)
Description
Build the runtime infrastructure that powers enterprise AI agents—systems that orchestrate, execute, and deliver agent responses in real time. You’ll combine LLM/ML and distributed systems expertise to make agents plan, reason, and use tools reliably, while building production-grade infrastructure for correctness, observability, and low latency.
Responsibilities
Build an agent orchestration engine using a state machine for long-running agent sessions
Implement model routing/adaptation, including fine-tuning or distillation for agent tasks and enterprise constraints
Design distributed session management with lease-based ownership, heartbeat, and crash recovery via checkpointing
Create an event-driven message pipeline with ordered delivery and real-time streaming
Apply structured concurrency for multi-task sessions with fail-fast and graceful cancellation
Build observability using OpenTelemetry with distributed tracing across async boundaries
Develop caching and state layers using Redis and DynamoDB KV stores with per-org/per-bot scoping
Enable tool and agent connectivity for LLMs, including MCP and agent-to-agent tool discovery/namespacing
Improve token efficiency and context engineering to reduce cost and latency
Stand up and evaluate open-weights models at different quantization levels and benchmark accuracy/latency/cost
Requirements
5+ years building production backend/infrastructure systems
Strong in Python or Go (ideally both)
Experience designing and operating systems that handle real traffic at scale
Hands-on experience building production systems using LLMs or other ML models
Deep experience in at least 3 areas: distributed systems, concurrent/async programming, event-driven architectures, database systems for infrastructure, observability, gRPC/protobuf, machine learning/LLMs
Comfort with ambiguity
Benefits
Base pay guideline: $161,300–$274,200 plus equity (when applicable), variable/incentive compensation
Health plans, flexible spending accounts, 401(k) match, ESPP, matching donations, flexible time away, family leave
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Senior Software Engineer, Agentic Platform
ServiceNow, Inc.
Senior
Technology
Mountain View, CA · On-site
N/A
8 days ago

Senior Software Engineer, Agentic Platform
ServiceNow
Senior
Technology
Mountain View, CA · On-site
$161K - $274K/yr
1 days ago

Senior Staff Machine Learning Engineer, Agentic Systems
ServiceNow, Inc.
Senior
Technology
Mountain View, CA · On-site
$201K - $352K/yr
8 days ago

Senior Staff Software Engineer, Agentic Systems
ServiceNow
Senior
Technology
Mountain View, CA · On-site
$201K - $352K/yr
3 days ago

Senior Software Engineer, Build Platform
Roblox
Senior
Technology
San Mateo, CA · On-site
$197K - $243K/yr
9 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.
Senior Platform Software Engineer, AI & Data Platforms
Apple
Senior
Technology
Sunnyvale, CA · On-site
$150K - $278K/yr
1 days ago

Senior/Staff Software Engineer (AI Agents)
Virco Talent
Senior
Technology
Remote
$210K - $230K/yr
5 days ago

Senior Software Engineer (Distributed Backend)
Workato
Senior
Technology
San Francisco, CA · On-site
N/A
8 days ago

AI Software Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6K - $8K/yr
11 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights
