
Senior AI Development Lead
Airbnb
11m ago • On-site
Senior
On-site
157,000 - 171,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Senior AI Development Lead role
Improve your resume now
$157,000 – $171,000/year
Quick Facts
- Role: Senior AI Development Lead (hands-on)
- Focus: Trusted AI workflows and feature enablement from design to launch
Description
Lead the design, build, and deployment of AI workflows and features, starting from how the work is done today and testing until results are trusted, then scaling to new problems. Drive quality by defining a measurement plan, building evaluation frameworks (including LLM judge calibration), and monitoring quality and drift after launch. Partner with engineering, product, and business stakeholders to make “good enough to launch” decisions with evidence.
Responsibilities
- Drive supported AI workflows/features from design to launch; set quality bar and measurement plan with partners.
- Prioritize projects by business impact and make trade-offs with product/business leads.
- Map current workflows, identify where AI can take over, and define human-in-the-loop steps for hard cases.
- Design and build AI workflows: prompts (when needed), pipeline/tooling, and live quality/drift monitoring.
- Build evaluation frameworks: test sets, accuracy and agreement metrics, and calibrate LLM judges vs. human reviewers.
- Collaborate with engineers on architecture/tooling decisions and pressure-test estimates/scope.
- Translate unclear guidelines into consistent reviewer criteria; align with product, Legal, and Policy.
- Produce human-verified labels using clear labeling guidelines; run labeling at scale and verify via agreement metrics and spot checks.
- Work with product teams early to define “good enough to launch”, and provide evidence for go/no-go.
- Build reusable evaluation/workflow components and document learnings for reuse.
- Keep methods current as models/tools/policies change and recommend what to retire.
Requirements
- 8+ years in product or program management, analytics, consulting, or applied AI; deliver technical programs from idea to production and own measurable outcomes.
- Strong SQL and statistical quality expertise (accuracy, precision/recall, sampling, reviewer agreement), including hands-on data analysis.
- Shipped AI-built workflows/agents/automations that others rely on; show measurable before-and-after impact and ability to diagnose failures.
- Technical fluency to pressure-test engineering estimates and understand how prompts, pipelines, and evaluations connect.
- Curiosity about real-world workflow exceptions; ability to make messy processes measurable and define success in business outcomes.
- Strong quality judgment from qualitative reviewer feedback; ability to synthesize what matters.
- Clear communication and cross-functional collaboration experience.
- Comfort prototyping firsthand and moving quickly when engineering support is not yet in place.
Benefits
- Hands-on ownership across workflow design, evaluation, and shipping with engineering and product.
- Compensation includes base pay plus potential bonus, equity, benefits, and Employee Travel Credits. (Base pay range: $157,000–$171,000 USD.)
- Remote eligible with occasional office/offsite participation as agreed with your manager.
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Senior AI Engineer
Motion Recruitment Partners, LLC
Senior
Technology
Boston, MA, United States of America · On-site
$200k - $225k/yr
16h ago

Senior AI Engineer
T-Mobile
Senior
Technology
Washington, WA · On-site
$153k - $276k/yr
1 days ago

Senior AI Engineer
The Evolvers Group
Senior
Technology
Remote
N/A
5 days ago
Senior AI Engineer
Sealed Air Corporation
Senior
Technology
Charlotte, NC · On-site
$93k - $161k/yr
12 days ago
Senior Applied AI Engineer
Flyps
Senior
Technology
Poznań, Pl-30, Poland · Remote
312k zł - 396k zł/yr
15 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior AI Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6k - $8k/yr
16 days ago
Senior AI Engineer
Craftware
Senior
Technology
Warsaw, Poland · Remote
N/A
8 days ago

Agent Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6k - $8k/yr
15 days ago
Senior Software Engineer
CoreLogic
Senior
Technology
Dallas, TX · On-site
$112k - $157k/yr
11 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights