Senior Software Engineer, Agentic Platform

ServiceNow, Inc.

Mountain View, CA, United States of America • 15m ago • On-site

Senior

On-site

161,300 - 274,200 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Potential salary for Senior Software Engineer, Agentic Platform role

Improve your resume now

$161,300 – $274,200/year

Quick Facts

  • Role: Senior Software Engineer (Agentic Platform / AI agent runtime infrastructure)

Description

Build the runtime infrastructure that powers enterprise AI agents—systems that orchestrate, execute, and deliver agent responses in real time. You’ll combine LLM/ML and distributed systems expertise to make agents plan, reason, and use tools reliably, while building production-grade infrastructure for correctness, observability, and low latency.

Responsibilities

  • Build an agent orchestration engine using a state machine for long-running agent sessions

  • Implement model routing/adaptation, including fine-tuning or distillation for agent tasks and enterprise constraints

  • Design distributed session management with lease-based ownership, heartbeat, and crash recovery via checkpointing

  • Create an event-driven message pipeline with ordered delivery and real-time streaming

  • Apply structured concurrency for multi-task sessions with fail-fast and graceful cancellation

  • Build observability using OpenTelemetry with distributed tracing across async boundaries

  • Develop caching and state layers using Redis and DynamoDB KV stores with per-org/per-bot scoping

  • Enable tool and agent connectivity for LLMs, including MCP and agent-to-agent tool discovery/namespacing

  • Improve token efficiency and context engineering to reduce cost and latency

  • Stand up and evaluate open-weights models at different quantization levels and benchmark accuracy/latency/cost

Requirements

  • 5+ years building production backend/infrastructure systems

  • Strong in Python or Go (ideally both)

  • Experience designing and operating systems that handle real traffic at scale

  • Hands-on experience building production systems using LLMs or other ML models

  • Deep experience in at least 3 areas: distributed systems, concurrent/async programming, event-driven architectures, database systems for infrastructure, observability, gRPC/protobuf, machine learning/LLMs

  • Comfort with ambiguity

Benefits

  • Base pay guideline: $161,300–$274,200 plus equity (when applicable), variable/incentive compensation

  • Health plans, flexible spending accounts, 401(k) match, ESPP, matching donations, flexible time away, family leave

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report