
Technical Certification Lead
OpenAI
San Francisco, CA • 32m ago • Hybrid
Senior
Hybrid
266,000 - 295,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Technical Certification Lead role
Improve your resume now
$266,000 – $295,000/year
Quick Facts
Role: Technical Certification Lead
Description
Lead the design, development, and ongoing quality of OpenAI’s technical role-based certifications. You will manage a team of Certification Assessment Specialists to build and maintain technical assessments and personally create competency models, job-task analyses, assessment blueprints, scoring rubrics, and passing criteria. You will validate AI-assisted scoring with calibrated human reviewers and ensure assessments stay relevant as AI roles evolve.
Responsibilities
Build and maintain competency models and facilitate job-task analyses with SMEs
Define and maintain assessment blueprints, scoring rubrics, evidence requirements, and passing criteria
Lead standard-setting with SMEs and a psychometrician/measurement specialist using a shared methodology
Validate AI-assisted scoring against calibrated human judgments; determine when human review is required and revalidate after material changes
Manage and develop assessment specialists; review work and oversee evidence capture and scoring workflows
Secure SME commitments across role analysis, task design, technical review, pilot feedback, and maintenance
Align curriculum to competency models and blueprints while keeping confidential assessment content separate
Own assessment quality using pilot results, scoring consistency checks, technical reviews, and candidate feedback
Provide technical input for candidate challenges and coordinate fixes with operations
Define and maintain recertification requirements and renewal evidence policies
Make evidence-based readiness recommendations for pilots, launches, and updates; coordinate technical handoff with operations and platform teams
Requirements
Led development and maintenance of role-based technical certifications/high-stakes technical assessments end-to-end
Managed and developed engineers or technical assessment specialists
Built competency models, facilitated job-task analyses, and created blueprints and rubrics
Designed hands-on assessments for software engineering, AI, cloud, or technical implementation roles
Built/validated AI-assisted scoring with appropriate human review
Recruited and coordinated SMEs and converted input into assessment decisions
Mapped curriculum/practice to competencies while maintaining separation between preparation and assessment
Communicated technical and measurement tradeoffs clearly
Benefits
The posting emphasizes success criteria focused on accessible assessments, consistent scoring, and making only the claims the evidence supports.
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Certification Assessment Specialist
OpenAI
Mid
Technology
San Francisco, CA · Hybrid
$207k - $230k/yr
32m ago

Certification Architect
OpenAI
Senior
Technology
San Francisco, CA · Hybrid
$266k - $295k/yr
6 days ago
AI Team Leader (k/m/n)
Nexio Management Sp. z o. o.
Senior
Technology
Warsaw, Poland · On-site
N/A
17 days ago

Technical Lead, AI Platform
DynPro Inc.
Senior
Technology
Remote
N/A
1 days ago

Tech Lead, Approvals
Zip
Senior
Technology
San Francisco, CA · On-site
$200k - $300k/yr
12h ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Technical Lead, AI Platform
DynPro Inc.
Senior
Technology
Remote
N/A
2 days ago

Lead Software Engineer (Java, Post-Trade Technology)
JPMorgan Chase & Co.
Senior
Technology
Jersey City, NJ, United States of America · On-site
$157k - $215k/yr
12 days ago

Lead Technical Recruiter
Bjak
Senior
Technology
Remote
N/A
5 days ago

AI Tech Lead
CodeTalent
Senior
Technology
Warsaw, Poland · Remote
34k zł - 43k zł/yr
17 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights