
Model Policy Manager, Agentic Safety
OpenAI
San Francisco, CA • 32m ago • Hybrid
Mid
Hybrid
207,000 - 335,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Model Policy Manager, Agentic Safety role
Improve your resume now
$207,000 – $335,000/year
Quick Facts
Role: Model Policy Manager, Agentic Safety
Focus: Agentic safety, model misalignment risks, and long-horizon behavior
Description
In this role, you will shape how real-world risks from model misalignment are understood and addressed as models become more autonomous and operate over longer horizons. You will investigate how misaligned behavior emerges across extended trajectories and translate those insights into behavioral policies, evaluations, monitoring, and safeguards. Your work turns alignment and safety concerns into empirically grounded improvements to frontier AI systems.
Responsibilities
Identify vulnerabilities that emerge as models interact with tools, data, and external systems, and translate them into model- and system-level safeguards
Develop threat models and empirical frameworks for understanding harmful outcomes from misaligned behavior
Build frameworks for understanding harmful outcomes arising from model misalignment
Identify underlying behaviors and system conditions that drive harmful outcomes
Turn findings into policy frameworks, evaluation criteria, online measurement, and safeguards
Develop human data campaigns and gold sets to ground measurement and evaluation of emerging behaviors and risks
Partner with research, engineering, security, and product teams to shape model and system safety
Inform deployment decisions, system cards, safeguards reports, and the broader approach to agentic safety
Build monitoring approaches to detect regressions and emerging risks after deployment
Requirements
Strong background in AI agent safety, privacy, security, cybersecurity, or adjacent fields with an adversarial mindset
Demonstrated interest in AI alignment and understanding of technical drivers of misaligned model behavior
Technical fluency to work with evaluation and training data and interpret data insights and limitations
Comfort working hands-on with model data and evaluation results, including inspecting examples, analyzing failure patterns, assessing data quality, and distinguishing policy failures from grader, model, or system failures
Use empirical evidence to develop and refine safety policies and safeguards
Translate complex or ambiguous alignment risks into precise behavioral expectations and measurable evaluation criteria
Work effectively across research, engineering, security, product, and policy
Communicate clearly about complex and uncertain technical risks
Enjoy fast-paced, collaborative research environments where priorities shift as models, evidence, and risks change
Benefits
Hybrid schedule: three days in the office per week with optional work from home on Thursdays and Fridays
Relocation support for new employees
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Agentic AI Engineer
Motion Recruitment Partners, LLC
Senior
Technology
Boston, MA, United States of America · On-site
$140k - $191k/yr
13 days ago
Engineering Program Manager, Responsible AI (Safety)
Apple
Senior
Technology
Cupertino, CA · On-site
$176k - $264k/yr
13 days ago

AI Software Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6k - $8k/yr
16 days ago

Research Engineer, Agentic Systems
Ramp
Senior
Technology
Remote
$204k - $352k/yr
1 days ago

Senior Software Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6k - $8k/yr
16 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Product Manager, Frontier Risks and Safety
OpenAI
Senior
Technology
San Francisco, CA · Hybrid
$347k - $445k/yr
32m ago
Engineering Program Manager, Responsible AI & Safety
Apple
Senior
Technology
Cupertino, CA · On-site
$176k - $264k/yr
13 days ago
Machine Learning Engineering Manager (Responsible AI & AI Safety)
Apple
Senior
Technology
CA · On-site
$206k - $356k/yr
8 days ago

Agent Engineer
AgileEngine
Senior
Technology
Kraków, Poland · Remote
$6k - $8k/yr
16 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights