Technical Lead, AI Platform

DynPro Inc.

1h ago • Remote

Senior

Remote

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

About the role

We’re building an enterprise platform for AI agents—a shared foundation that helps engineering teams build, deploy, and run secure, reliable, and cost-effective agents at scale.

As the Technical Lead, AI Platform, you’ll own end-to-end platform design and delivery while guiding a team of engineers and staying hands-on in the code.

Responsibilities

  • Own the design and delivery of the platform from first design through production operation
  • Write code, review designs and pull requests, and take on the hardest problems
  • Build reusable platform capabilities with clear interfaces, versioning, and documentation
  • Set and uphold engineering standards for quality, security, observability, and evaluation
  • Improve latency, reliability, and cost for production AI workloads
  • Define SLOs, participate in on-call, and lead incident reviews
  • Partner with architects, product managers, security, and domain teams

What you’ll work on

  • Agent harness and SDK: frameworks and tools engineers use to build and run agents
  • AI infrastructure and governance: secure, policy-controlled access to models, tools, and data
  • Context and memory: getting agents the right information at the right time
  • Evaluation and observability: measuring agent quality, cost, and behavior before and after release
  • AI user experiences: how agents appear in applications, assistants, and partner integrations
  • Applied agents: building production agents on the platform alongside domain teams

Requirements

  • Bachelor’s degree in computer science or a related field, or equivalent practical experience
  • 8+ years building and running production backend or distributed systems, including 2+ years as a technical lead
  • Hands-on experience shipping LLM-powered applications or agents to production, and handling failure
  • Strong Python experience, including designing frameworks, SDKs, or platform APIs used by other engineers
  • Solid distributed systems fundamentals: API design, asynchronous and event-driven processing, streaming, caching, rate limiting, fault tolerance
  • Clear written communication, including design docs that explain trade-offs

Technical skills & technologies

  • Agent development: tool/function calling, orchestration, task delegation, durable execution, human-in-the-loop approvals
  • Agent interoperability: open protocols for agents and tools
  • Context engineering: RAG, vector/hybrid search, memory, summarization, tool selection
  • LLM evaluation: eval datasets/rubrics, LLM-as-judge, regression testing in CI, online evaluation
  • LLM infrastructure: model provider routing, token/cost management, response caching, latency optimization
  • AI safety & governance: guardrails, prompt-injection defense, PII detection/redaction, policy engines, sandboxed execution
  • Security: authentication/authorization, service identity, least-privilege, tenant isolation, audit logging
  • Observability: distributed tracing, metrics, logging, SLOs, LLM observability
  • Cloud-native: containers, orchestration, CI/CD, infrastructure as code

Languages: Python (must); SQL (working knowledge); Java (plus)

  • Agent frameworks: LangGraph, LangChain, OpenAI Agents SDK, Google ADK, Pydantic AI
  • Agent protocols: MCP, A2A, A2UI
  • Models/providers: OpenAI, Anthropic, Google Gemini, Amazon Bedrock, Azure OpenAI; vLLM; LiteLLM
  • Backend/APIs: FastAPI, asyncio, Pydantic; REST, gRPC, Server-Sent Events, WebSockets; Kafka
  • Data/retrieval: PostgreSQL, pgvector; OpenSearch, Elasticsearch, Qdrant; Redis
  • Evaluation/observability: OpenTelemetry (GenAI conventions), LangSmith, Ragas, DeepEval, Prometheus, Grafana
  • Security/governance: OAuth 2.0, OIDC, JWT; SPIFFE/SPIRE; Open Policy Agent, Cedar; HashiCorp Vault; NeMo Guardrails, Llama Guard, Presidio
  • Cloud/infrastructure: Docker, Kubernetes, Helm; Terraform; AWS/Azure/GCP; GitHub Actions/Jenkins; gVisor, Firecracker
  • Front end: React; streaming chat/agent interfaces; Vercel AI SDK, A2UI, MCP-UI

Preferred qualifications

  • Experience building an internal platform/SDK/framework adopted by multiple teams
  • Experience running AI systems for external enterprise customers
  • Contributions to open-source agent frameworks or protocols

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report