
AI Software Architect (Lead)
J-RAM IT Consulting Inc.
Palo Alto, CA, United States of America • 18m ago • Hybrid
Senior
Hybrid
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Quick Facts
- Role: Hybrid AI Focus Software Architect / Lead (Applied AI Developer, Enterprise AI team)
- Focus: Agentic workflows, LLM orchestration, model governance, and building production-ready AI platforms
- Assessment: Assessment and in-person (F2F) interview required
Description
You will evaluate where AI fits, build the tools and platforms that make AI practical, and help teams adopt modern AI development patterns—especially LLM orchestration, agentic workflows, and model governance. You will stay hands-on with prototyping, evaluating emerging technologies, and shipping solutions that improve organizational efficiency. You’ll also set quality and reliability through automated evals and regression frameworks.
Responsibilities
- AI-first: assess where agentic approaches outperform conventional solutions, and own the quality bar with automated evals, simulation tests, and regression frameworks.
- Design agentic systems: tool orchestration, agent reasoning, memory, MCP integrations, and human-in-the-loop workflows.
- AI governance patterns: implement guardrails, data lineage, auditability, and responsible AI practices for safe, compliant, trustworthy agents.
- Drive adoption: run pilots, proofs-of-concept, and scalable rollouts across engineering teams.
- Cross-functional collaboration: partner with product, security, platform, and business stakeholders to deliver end-to-end production solutions.
Requirements
- 5+ years of professional software engineering; at least 2 years focused on applied AI in production systems.
- Proficient in Python and/or Go; comfortable reading and writing in the other.
- Proven production experience building and scaling multi-agent or agent-driven systems with real operational ownership.
- Hands-on experience with modern agent ecosystems/frameworks (e.g., LangGraph, Google ADK, Mastra, Claude Agent SDK) and observability/evals tooling (e.g., Langfuse, LangSmith, Braintrust), plus MCP implementations and AI SDKs (e.g., OpenAI, Anthropic).
- Strong systems and backend architecture fundamentals (infrastructure, performance, failure modes, cost, deployment).
- Cloud-native understanding (Google Cloud Platform and/or AWS).
- Enterprise API integration experience (REST, GraphQL) and authN/authZ patterns (OAuth2, SAML, API keys, RBAC).
- Database experience (SQL and NoSQL): queries, data models, and RBAC-enforcing data access layers.
- Strong communication and collaboration with cross-functional teams.
- Ability to raise engineering standards and execution quality.
Nice to Have
- Experience with AI evaluation tooling (Langfuse, LangSmith, Braintrust, or custom eval frameworks).
- Experience building custom MCP servers.
- Familiarity with Docker and Kubernetes.
- Inference cost optimization experience for scaling agent deployments.
- Experience with AI-powered coding agents (e.g., Claude Code, GitHub Copilot, Cursor, Windsurf).
- RAG and document retrieval pipeline experience (vector databases, embedding models, chunking, hybrid search) for grounding answers in enterprise documentation.
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Lead AI Architect (Agentic AI)
Corus Consulting
Senior
Technology
New York, NY · Hybrid
N/A
8 days ago

Lead Agentic AI Solutions Engineer
CVS Health
Senior
Technology
CT · Remote
$130k - $261k/yr
5 days ago

Agent Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6k - $8k/yr
13 days ago

AI Agent Engineer
UNIQA
Mid
Technology
Warsaw, Poland · On-site
N/A
13 days ago

Agentic AI Engineer
Motion Recruitment Partners, LLC
Senior
Technology
Boston, MA, United States of America · On-site
$140k - $191k/yr
11 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Cloud Solutions Architect
Booz Allen Hamilton
Senior
Technology
Fayetteville, NC · On-site
$99k - $225k/yr
11 days ago

AI Engineer (Agent & Solution Engineering)
UNIQA
Mid
Technology
Warsaw, Poland · On-site
N/A
13 days ago

Lead AI Solutions Architect
Perfict Global, Inc.
Senior
Technology
Newton, MA · Hybrid
N/A
6 days ago

Senior AI Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6k - $8k/yr
14 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights