AI Engineer

Innovative IT Solutions Inc

Malvern, PA • 1h ago • Hybrid

Mid

Hybrid

104,000 - 104,000 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for AI Engineer role

Improve your resume now

$104,000 – $104,000/year

Quick Facts

  • Role: AI Engineer

  • Work arrangement: Onsite (3 days per week)

  • Location: Malvern, PA

  • Pay rate: $50/hour W2

Description

Join a hands-on team building and enhancing an internal AI-powered developer platform. The work focuses on stateful, human-in-the-loop AI agent workflows using LangGraph and Python, plus automated evaluation frameworks to measure agent performance. You will also support A/B testing, prompt optimization, and human-agent interactive UI capabilities.

Responsibilities

  • Design, develop, and debug stateful AI agent workflows using LangGraph

  • Implement agent state management, checkpointing, interrupts, and tool-calling capabilities

  • Extend and maintain automated LLM evaluation frameworks

  • Conduct A/B testing across different agent workflows and prompt variations

  • Optimize prompts using measurable improvements and regression testing

  • Evaluate AI agent performance based on response quality, cost, and latency

  • Develop and enhance human-agent interactive UI capabilities

  • Ensure reliability, consistency, and performance of AI-driven workflows

Requirements

  • Strong hands-on experience with LangGraph (state graphs, checkpointing, interrupts, tool-calling agents)

  • Experience with LLM evaluation frameworks (golden datasets, LLM-as-a-Judge, A/B testing)

  • Strong prompt engineering skills (structured outputs, prompt optimization)

  • Strong Python programming experience

  • Experience developing and testing production-ready AI agent workflows

  • Ability to measure and improve LLM performance through automated evaluation and regression testing

Benefits

  • $50/hour W2

  • Onsite work (3 days per week)

  • Online technical assessment required as part of the interview process

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report