Research Data Scientist, Search Quality

Minimum qualifications:

• Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, a related quantitative field, or equivalent practical experience.
• 5 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 3 years of work experience with a PhD degree.
  

Preferred qualifications:

• 8 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 6 years of work experience with a PhD degree
  
• Experience working on 0 to 1 products.
• Experience working with eval data.

About the job

In this role, you will evaluate and improve the Google Search user experience. The team works on problems at the frontiers of generative AI evaluation, and collaborates cross-functionally. You will use available data sources to bring analytical and statistical methods to the challenges of measuring quality, developing metrics, and improving training data for model development.

As a key member of the team, you will work with engineers and researchers to analyze/interpret data, develop metrics, and integrate new methodologies into existing evaluation systems.

The Core Ranking DS team develops and supports evaluation methodology and metrics used to guide and develop Search Quality models and iteration, as well as the Search product as a whole. You will work with engineers, researchers, and product managers within and outside of Search to bring helpful and trustworthy content to Search users.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Responsibilities

• Work with data sets, solve non-routine analysis problems, apply analytical methods as needed, conduct analysis that includes data gathering and requirements specification, processing, analysis, ongoing deliverables, and presentations.
• Build and prototype analysis pipelines iteratively to provide insights at scale, develop knowledge of Google data structures and metrics, advocating for changes where needed for both products development and business strategy.
• Interact cross-functionally with a wide variety of people and teams, and work with engineers to identify opportunities for design, and assess improvements to Google products.
• Make business recommendations (e.g., cost-benefit, forecasting, experiment analysis) with presentations of findings at multiple levels of stakeholders through visual displays of quantitative information.
• Research and develop analysis methods to improve the quality of Google Search.