
AI Engineer
Innovative IT Solutions Inc
Malvern, PA • 1h ago • Hybrid
Mid
Hybrid
104,000 - 104,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for AI Engineer role
Improve your resume now
$104,000 – $104,000/year
Quick Facts
Role: AI Engineer
Work arrangement: Onsite (3 days per week)
Location: Malvern, PA
Pay rate: $50/hour W2
Description
Join a hands-on team building and enhancing an internal AI-powered developer platform. The work focuses on stateful, human-in-the-loop AI agent workflows using LangGraph and Python, plus automated evaluation frameworks to measure agent performance. You will also support A/B testing, prompt optimization, and human-agent interactive UI capabilities.
Responsibilities
Design, develop, and debug stateful AI agent workflows using LangGraph
Implement agent state management, checkpointing, interrupts, and tool-calling capabilities
Extend and maintain automated LLM evaluation frameworks
Conduct A/B testing across different agent workflows and prompt variations
Optimize prompts using measurable improvements and regression testing
Evaluate AI agent performance based on response quality, cost, and latency
Develop and enhance human-agent interactive UI capabilities
Ensure reliability, consistency, and performance of AI-driven workflows
Requirements
Strong hands-on experience with LangGraph (state graphs, checkpointing, interrupts, tool-calling agents)
Experience with LLM evaluation frameworks (golden datasets, LLM-as-a-Judge, A/B testing)
Strong prompt engineering skills (structured outputs, prompt optimization)
Strong Python programming experience
Experience developing and testing production-ready AI agent workflows
Ability to measure and improve LLM performance through automated evaluation and regression testing
Benefits
$50/hour W2
Onsite work (3 days per week)
Online technical assessment required as part of the interview process
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
AI Engineer
Awareson Sp. z o.o.
Mid
Technology
Warsaw, Poland · Remote
N/A
12 days ago

AI Engineer
ASTEK Polska
Senior
Technology
Warsaw, Maz, Poland · Remote
N/A
13 days ago

AI Engineer
Oscar Technology
Mid
Technology
New York, NY · On-site
$145k - $180k/yr
4 days ago

AI Engineer - Agentic AI
Team Connect
Senior
Technology
Warsaw, Poland · Remote
N/A
11 days ago

AI Engineer (Agentic AI / LLM)
DCV Technologies
Mid
Technology
Warsaw, Poland · Remote
N/A
4 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior Python / LangGraph Engineer
EPAM Systems
Senior
Technology
Wroclaw, Poland · Remote
N/A
8 days ago

AI Engineer
Oscar Technology
Mid
Technology
New York, NY · On-site
$145k - $200k/yr
6 days ago

AI Engineer
QUANTUM TECHNOLOGIES LLC
Senior
Technology
Remote
$125k - $152k/yr
1 days ago
AI Engineer (m/w/d) – Generative AI & AI-Agenten
AXA
Mid
Technology
Cologne, Germany · On-site
€42k - €73k/yr
16 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights