Senior AI Development Lead

Airbnb

11m ago • On-site

Senior

On-site

157,000 - 171,000 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for Senior AI Development Lead role

Improve your resume now

$157,000 – $171,000/year

Quick Facts

  • Role: Senior AI Development Lead (hands-on)
  • Focus: Trusted AI workflows and feature enablement from design to launch

Description

Lead the design, build, and deployment of AI workflows and features, starting from how the work is done today and testing until results are trusted, then scaling to new problems. Drive quality by defining a measurement plan, building evaluation frameworks (including LLM judge calibration), and monitoring quality and drift after launch. Partner with engineering, product, and business stakeholders to make “good enough to launch” decisions with evidence.

Responsibilities

  • Drive supported AI workflows/features from design to launch; set quality bar and measurement plan with partners.
  • Prioritize projects by business impact and make trade-offs with product/business leads.
  • Map current workflows, identify where AI can take over, and define human-in-the-loop steps for hard cases.
  • Design and build AI workflows: prompts (when needed), pipeline/tooling, and live quality/drift monitoring.
  • Build evaluation frameworks: test sets, accuracy and agreement metrics, and calibrate LLM judges vs. human reviewers.
  • Collaborate with engineers on architecture/tooling decisions and pressure-test estimates/scope.
  • Translate unclear guidelines into consistent reviewer criteria; align with product, Legal, and Policy.
  • Produce human-verified labels using clear labeling guidelines; run labeling at scale and verify via agreement metrics and spot checks.
  • Work with product teams early to define “good enough to launch”, and provide evidence for go/no-go.
  • Build reusable evaluation/workflow components and document learnings for reuse.
  • Keep methods current as models/tools/policies change and recommend what to retire.

Requirements

  • 8+ years in product or program management, analytics, consulting, or applied AI; deliver technical programs from idea to production and own measurable outcomes.
  • Strong SQL and statistical quality expertise (accuracy, precision/recall, sampling, reviewer agreement), including hands-on data analysis.
  • Shipped AI-built workflows/agents/automations that others rely on; show measurable before-and-after impact and ability to diagnose failures.
  • Technical fluency to pressure-test engineering estimates and understand how prompts, pipelines, and evaluations connect.
  • Curiosity about real-world workflow exceptions; ability to make messy processes measurable and define success in business outcomes.
  • Strong quality judgment from qualitative reviewer feedback; ability to synthesize what matters.
  • Clear communication and cross-functional collaboration experience.
  • Comfort prototyping firsthand and moving quickly when engineering support is not yet in place.

Benefits

  • Hands-on ownership across workflow design, evaluation, and shipping with engineering and product.
  • Compensation includes base pay plus potential bonus, equity, benefits, and Employee Travel Credits. (Base pay range: $157,000–$171,000 USD.)
  • Remote eligible with occasional office/offsite participation as agreed with your manager.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report