Data Scientist, Integrity

OpenAI

San Francisco, CA • 32m ago • Hybrid

Mid

Hybrid

265,000 - 380,000 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Or go to the original job offer

Potential salary for Data Scientist, Integrity role

Improve your resume now

$265,000 – $380,000/year

Quick Facts

Data Scientist focused on Integrity for AI abuse prevention and authentic usage measurement.

Description

Investigate emerging abuse patterns, estimate their impact, and lead analytical work behind decisions on detection, enforcement, and product launches. Partner across Product, Engineering, Research, Policy, and Operations to translate findings into improvements and measure results after release.

Responsibilities

  • Investigate anomalous activity across products and estimate prevalence, affected users, and business/user costs.
  • Define outcome metrics and guardrails; establish baselines; build monitoring for changes in abuse, customer friction, and operational performance.
  • Build and evaluate detection rules, classifiers, and human review workflows using labeled samples and review outcomes.
  • Design randomized holdouts and apply quasi-experimental/observational methods when randomization is impractical; estimate harm/fraud prevented and effects on legitimate users, revenue, compute, and review workload.
  • Trace where signals, review decisions, or enforcement actions break down; build reusable datasets, analyses, and investigation tools.

Requirements

  • Fluent in SQL and Python; able to verify AI-generated queries, code, and conclusions against underlying data.
  • Strong statistical judgment; experience with experimentation, causal inference, or observational analysis.
  • Ability to reason from incomplete or biased labels and explain how uncertainty affects decisions.
  • Ownership of open-ended problems from measurement definition to action recommendation and impact verification.
  • Clear communication with both technical and nontechnical partners and ability to explain tradeoffs.
  • Experience in integrity/trust & safety, fraud or risk analytics, security analytics, or applied ML evaluation is helpful; experience evaluating detection systems, human review, or LLM-based classifiers is a plus.

Benefits

  • Equal opportunity employer; background checks and fair-chance considerations per applicable law.
  • Reasonable accommodations available for applicants with disabilities.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report