AI Software Architect (Lead)

J-RAM IT Consulting Inc.

Palo Alto, CA, United States of America • 18m ago • Hybrid

Senior

Hybrid

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Quick Facts

  • Role: Hybrid AI Focus Software Architect / Lead (Applied AI Developer, Enterprise AI team)
  • Focus: Agentic workflows, LLM orchestration, model governance, and building production-ready AI platforms
  • Assessment: Assessment and in-person (F2F) interview required

Description

You will evaluate where AI fits, build the tools and platforms that make AI practical, and help teams adopt modern AI development patterns—especially LLM orchestration, agentic workflows, and model governance. You will stay hands-on with prototyping, evaluating emerging technologies, and shipping solutions that improve organizational efficiency. You’ll also set quality and reliability through automated evals and regression frameworks.

Responsibilities

  • AI-first: assess where agentic approaches outperform conventional solutions, and own the quality bar with automated evals, simulation tests, and regression frameworks.
  • Design agentic systems: tool orchestration, agent reasoning, memory, MCP integrations, and human-in-the-loop workflows.
  • AI governance patterns: implement guardrails, data lineage, auditability, and responsible AI practices for safe, compliant, trustworthy agents.
  • Drive adoption: run pilots, proofs-of-concept, and scalable rollouts across engineering teams.
  • Cross-functional collaboration: partner with product, security, platform, and business stakeholders to deliver end-to-end production solutions.

Requirements

  • 5+ years of professional software engineering; at least 2 years focused on applied AI in production systems.
  • Proficient in Python and/or Go; comfortable reading and writing in the other.
  • Proven production experience building and scaling multi-agent or agent-driven systems with real operational ownership.
  • Hands-on experience with modern agent ecosystems/frameworks (e.g., LangGraph, Google ADK, Mastra, Claude Agent SDK) and observability/evals tooling (e.g., Langfuse, LangSmith, Braintrust), plus MCP implementations and AI SDKs (e.g., OpenAI, Anthropic).
  • Strong systems and backend architecture fundamentals (infrastructure, performance, failure modes, cost, deployment).
  • Cloud-native understanding (Google Cloud Platform and/or AWS).
  • Enterprise API integration experience (REST, GraphQL) and authN/authZ patterns (OAuth2, SAML, API keys, RBAC).
  • Database experience (SQL and NoSQL): queries, data models, and RBAC-enforcing data access layers.
  • Strong communication and collaboration with cross-functional teams.
  • Ability to raise engineering standards and execution quality.

Nice to Have

  • Experience with AI evaluation tooling (Langfuse, LangSmith, Braintrust, or custom eval frameworks).
  • Experience building custom MCP servers.
  • Familiarity with Docker and Kubernetes.
  • Inference cost optimization experience for scaling agent deployments.
  • Experience with AI-powered coding agents (e.g., Claude Code, GitHub Copilot, Cursor, Windsurf).
  • RAG and document retrieval pipeline experience (vector databases, embedding models, chunking, hybrid search) for grounding answers in enterprise documentation.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report