Engineering Analyst, Responsible AI Testing, Child Safety

Minimum qualifications:

• Bachelor's degree in Political Science, Communications, Computer Science, Data Science, History, International Affairs, Social Work, Child Development, related discipline, or equivalent professional experience.
• 7 years of experience managing projects and defining project scope, goals, and deliverables.
  
• 7 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from data.
• 5 years of experience working in a Trust and Safety Operations, data analytics, cybersecurity, or other relevant environment.

Preferred qualifications:

• Master's degree.
• 7 years of experience or familiarity with machine learning systems.
  
• 7 years of experience or familiarity with one or more of the following languages: SQL, R, Python, or C++.
• Experience working with Large Language Models (LLMs), LLM Operations, prompt engineering, pre-training, and fine-tuning.
  
• Excellent communication and presentation skills (written and verbal) and the ability to influence cross-functionally at various levels.
• Excellent problem-solving and critical thinking skills with attention to detail in an ever-changing environment.

About the job

Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you're a big-picture thinker and strategic team-player with a passion for doing what’s right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed - with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.

As an Engineering Analyst within the Trust and Safety Responsible AI Testing team, you’ll be part of a global team that drives One Google solutions for industry-leading responsible AI applications. Your role will focus particularly on the broad spectrum of online child abuse and exploitation risks and will prioritize close partnerships with colleagues in Google Deep Mind (GDM) to design and develop solutions to further Google’s ability to prevent child abuse on GDM base models. You will blend your deep domain expertise in child safety policy and GenAI testing processes with technological acumen to drive creative and ambitious solutions to challenges, with the ultimate impact of preventing child abuse.

The US base salary range for this full-time position is $174,000-$258,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Responsibilities

• Be responsible for model-level safety, drive structured and unstructured testing of novel model modalities and capabilities. Define the testing and child safety standards applicable to the product, and work with cross-functional colleagues, especially those from legal and engineering teams.
• Perform analyses and drive insights that help develop both model-level and product-level mitigations for child safety and quality. Identify opportunities for the improvement of Google’s systems as well as for automation, including model inference and evaluation tooling, leveraging LLMs for labeling model outputs, evaluating classifiers and filters.
• Lead multiple interdependent projects of high complexity and scope. Work cross-functionally to ensure coordination and alignment on objectives and key results, and represent T&S RAI Testing for Child Safety at the highest levels internally and externally.
• This role may be exposed to graphic, controversial, and/or upsetting content.