Software Engineer II, AI Agent Platform

JPMorgan Chase & Co.

Hoboken, NJ • 8m ago • On-site

Mid

On-site

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Quick Facts

  • Role: Software Engineer II, AI Agent Platform
  • Focus: Platform engineering for LLM-powered AI agents

Description

Build core platform capabilities—SDK features, orchestration patterns, reusable components, and quality tooling—that enable teams to create conversational, voice, and document-extraction agent experiences at scale. Help transform complex problems into dependable production systems by improving reliability, accuracy, and operational stability through disciplined evaluation and iteration. Collaborate with engineers, product partners, and risk/security stakeholders to ship measurable performance and developer-experience improvements.

Responsibilities

  • Build core SDK features and reusable components for composing and operating AI agents consistently and safely.
  • Implement orchestration and tool/function-calling patterns for reliability, traceability, and developer experience.
  • Develop retrieval and grounding capabilities that connect agents to approved data sources.
  • Create evaluation datasets, benchmarks, and quality metrics to measure capability accuracy.
  • Add testing, observability, and monitoring features (tracing, logs, latency and cost metrics).
  • Translate requirements into secure, scalable, production-ready solutions with cross-functional stakeholders.
  • Contribute documentation, examples, and reference implementations to accelerate adoption.
  • Participate in code reviews and design discussions to improve maintainability and performance.

Requirements

  • Formal training or certification on software engineering concepts plus 2+ years applied experience.
  • 2+ years hands-on Python development experience delivering production software.
  • Experience building and operating backend services or platform components with reliability, performance, and maintainability in mind.
  • Experience writing automated tests and using version control and code review practices.
  • Experience integrating application components with data sources, plus robust error-handling and observability practices.
  • Ability to break down ambiguous problems into clear deliverables, iterate quickly, and communicate trade-offs.
  • Strong collaboration and communication skills with a focus on outcomes and continuous improvement.

Benefits

  • Competitive total rewards package including base salary determined by role, experience, skill set, and location.
  • Possible commission-based pay and/or discretionary incentive compensation for eligible roles.
  • Comprehensive health care coverage, retirement savings plan, tuition reimbursement, mental health support, and other programs; additional details provided during hiring.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report