Software Engineer II (AI Agent Platform)

JPMorgan Chase & Co.

Jersey City, NJ • 21m ago • On-site

Mid

On-site

123,500 - 150,000 USD/yr

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Quick Facts

  • Role: Software Engineer II (AI Agent Platform)
  • Focus: Platform engineering for LLM-powered AI agents (SDK, orchestration, retrieval/grounding, evaluation, and operability)

Description

Contribute to an AI Agent Platform by building core building blocks—SDK features, orchestration patterns, reusable components, and quality tooling—that help teams deliver conversational, voice, and document-extraction agent experiences. Work on reliable production systems for large-language-model-powered agents at scale, improving performance, developer experience, and operational stability through disciplined evaluation and iteration.

Responsibilities

  • Build core SDK features and reusable components for consistent and safe AI agent composition and operation.
  • Implement orchestration and tool/function-calling patterns to improve reliability and traceability.
  • Develop retrieval and grounding capabilities connected to approved data sources.
  • Create evaluation datasets, benchmarks, and quality metrics for capability accuracy.
  • Add testing, observability, and monitoring (tracing, logs, latency, cost) for operability and incident readiness.
  • Translate requirements into secure, scalable, production-ready solutions with cross-functional stakeholders.
  • Contribute documentation, examples, and reference implementations to accelerate adoption.
  • Participate in code reviews and design discussions to raise engineering standards.

Requirements

  • Formal training or certification on software engineering concepts plus 2+ years applied experience.
  • 2+ years hands-on Python development delivering production software.
  • Experience building and operating backend services/platform components with reliability, performance, and maintainability.
  • Experience writing automated tests and using version control and code review practices.
  • Experience integrating application components with data sources and building robust error-handling and observability.
  • Ability to break down ambiguous problems, iterate quickly, and communicate trade-offs.
  • Strong collaboration and communication skills focused on outcomes and continuous improvement.

Benefits

  • Competitive total rewards package; base salary determined by role, experience, skills, and location.
  • Possible commission-based pay and/or discretionary incentive compensation (cash and/or forfeitable equity).
  • Benefits may include comprehensive health care, wellness centers, retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching, and more (eligibility-dependent).
  • Equal opportunity employer; accommodations available for applicants/employees’ religious practices and mental health/physical disability needs.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Potential salary for Software Engineer II (AI Agent Platform) role

Improve your resume for just $5

$123,500 – $150,000/year

Unlock Full Resume Report