Senior Backend AI Engineer
Stanley David and Associates
New York, NY, United States of America • 22m ago • On-site
Senior
On-site
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Quick Facts
Role: Senior Backend AI Engineer
Location: New York, NY / Phoenix, AZ
Description
Design, develop, and maintain scalable backend systems that power applications, with a strong focus on LLM systems and agentic workflows. Build and operate production-grade agentic AI capabilities used across multiple products, covering orchestration, planning, tool use, memory, retrieval/grounding (RAG), inference/model gateways, and evaluation/safety/observability. Lead architecture and technical design reviews while collaborating with cross-functional teams to deliver reliable, high-performance services.
Responsibilities
Design and implement high-performance backend services and APIs
Architect and deliver features with cross-functional teams
Optimize backend performance, scalability, and reliability under high load
Drive technical direction for agentic AI initiatives (autonomy boundaries, architecture patterns)
Build, operate, and evolve shared agentic AI capabilities (frameworks, orchestration layers, planning/tool use/memory, RAG, LLM infrastructure, evaluation/observability/safety)
Lead technical design reviews and manage tradeoffs across autonomy, safety, reliability, scalability, and cost
Apply best practices for code quality, testing, and deployment automation
Work with DevOps to deploy and manage backend services in cloud environments (AWS/Azure/Google Cloud)
Define API contracts with frontend engineers and ensure backend/frontend integration
Provide project updates, status reports, and technical recommendations
Requirements
7+ years of backend engineering experience
Strong distributed systems background
Experience with NodeJS/Javascript/TypeScript and/or Golang; ability to build large-scale distributed systems (10+ years preferred in the posting)
Experience with LLM systems and agentic workflows or advanced ML infrastructure
Demonstrated ownership of complex, cross-cutting agentic systems across multiple teams or products
Deep agentic AI stack experience: planning, tool use, memory, and evaluation
Experience with workflow engines, async processing, queues, and streaming systems
Cloud and containerization experience (AWS and/or Google Cloud Platform; Kubernetes; Docker)
Database proficiency: SQL (e.g., PostgreSQL) and NoSQL (e.g., MongoDB, Redis)
Version control and CI/CD experience (e.g., Git, CI/CD pipelines)
Strong communication and collaboration skills
Bachelor’s degree in Computer Science/Engineering or related field (Master’s preferred)
Benefits
Not specified in the provided posting.
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Senior AI Engineer
T-Mobile
Senior
Technology
Washington, WA · On-site
$153k - $276k/yr
15m ago

Senior Agentic AI Engineer
Highbrow Technology Inc
Senior
Technology
Remote
N/A
5 days ago

Senior AI Engineer (Agentic Systems)
Luxoft
Senior
Technology
Los Angeles, CA · On-site
N/A
5 days ago
Senior Software Engineer Agentic AI applications
Deutsche Telekom Services Europe Czech Republic s.r.o.
Senior
Technology
Brno, Czech Republic · Remote
N/A
4 days ago

Senior Software Engineer – Agentic AI Solutions
j-labs
Senior
Technology
Kraków, Poland · On-site
N/A
13 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.
Senior Applied AI Engineer
Flyps
Senior
Technology
Poznań, Pl-30, Poland · Remote
312k zł - 396k zł/yr
13 days ago

Senior/Staff Software Engineer (AI Agents)
Virco Talent
Senior
Technology
Remote
$210k - $230k/yr
7 days ago

Senior Software Engineer, AI
Thomson Reuters U.S. Inc.
Senior
Technology
Eagan, MN · On-site
$118k - $220k/yr
2 days ago
Senior AI Engineer
Craftware
Senior
Technology
Warsaw, Poland · Remote
N/A
6 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights