AI Engineer

Innovative IT Solutions Inc

Malvern, PA • 1h ago • On-site

Mid

On-site

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Quick Facts

  • Role: AI Engineer
  • Focus: LangGraph agent workflows, LLM evaluation, A/B testing, prompt improvements, and a human-agent interactive UI

Description

Build and debug LangGraph agent workflows, including extending an evaluation harness and running A/B tests between agent and prompt variants. Use measured, regression-tested prompt changes to improve output quality, cost, and latency. Extend a human-agent interactive UI to support the workflow.

Responsibilities

  • Build and debug LangGraph agent workflows
  • Extend the evaluation harness and run A/B tests between agent and prompt variants
  • Improve prompts with measured, regression-tested changes
  • Extend human-agent interactive UI

Requirements

  • LangGraph experience: state graphs, checkpointing, interrupts, tool-calling agents
  • LLM evals: golden sets, LLM-as-judge, A/B comparisons on quality, cost, and latency
  • Robust prompt engineering, including structured outputs
  • Proficiency in Python

Benefits

Opportunity to work on production-grade agent workflows and evaluation-driven prompt iteration.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report