Research Data Scientist, GenAI Quality, YouTube

Minimum qualifications:

• Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field.
  
• 3 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or a PhD degree.
  
• Experience in Machine Learning.

Preferred qualifications:

• PhD in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field.
• 5 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or a PhD degree.
  
• Experience in reading and applying quantitative methodologies from the academic literature.
• Expertise working with Large Language Models, GenAI Evaluation, AI tools, or Multimodal Machine Learning.

About the job

In this role, you will help shape the future of the Creator Economy by ensuring YouTube rewards high-value innovation over low-quality, automated content. You will partner with stakeholders in the YouTube Partner Program to measure and mitigate the risks associated with synthetic media. You will be a core member of the working group studying the rise of generative media. You will act as the bridge between detection and economics, using science to ensure our business generation encourages high-quality GenAI content while defunding abusive, low-effort generation.At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

The US base salary range for this full-time position is $141,000-$202,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Responsibilities

• Develop the methodology for measuring low-quality synthetic content within the business generation ecosystem. Establish the definitions and frameworks required to distinguish creative tool utilization from abusive mass-production.
• Design methodologies to validate Large Language Model (LLM) performance on nuanced content tasks. Leverage LLMs to develop and deploy 'hybrid' and 'LLM-first' metrics that distinguish between creative and repetitive content.
• Apply sampling theory and optimization techniques to our north star metrics for business generation safety.
• Own the process of gathering, extracting, compiling, and analyzing data across sources via relevant tools (e.g., SQL, R, Python).