Senior Data Scientist

Quick Facts

• Role: Senior Data Scientist
• Focus: Outlook and Copilot data science, analytics, experimentation, and AI evaluation

Description

You will lead high-visibility data science initiatives across Outlook Mail, Calendar, Search, and Copilot experiences. The role involves defining success metrics, building trusted measurement systems, evaluating generative AI/agentic experiences, and translating complex data into product decisions.

Responsibilities

• Design and execute analytical frameworks to evaluate product investments across Outlook and Copilot.
• Define metrics and feature-level success criteria; design value measures, guardrails, funnels, and retention.
• Plan and analyze online experiments, quasi-experiments, and observational studies for causal impact and ship decisions.
• Build dashboards, semantic models, and reporting pipelines to monitor product health, experimentation outcomes, AI quality/reliability/latency, sentiment, and adoption.
• Evaluate generative AI and agentic experiences using offline/online evaluation (benchmarks, human judgment, LLM-as-a-judge, error analysis, production telemetry).
• Improve AI response quality with prompt engineering and evaluation (grounding, relevance, safety, task completion).
• Partner on model selection, feature development, post-training signals, and measurement strategies.
• Use behavioral and telemetry data to diagnose issues, forecast trends, and identify opportunities.
• Influence product strategy by communicating actionable insights to senior leaders.
• Mentor the community to raise statistical rigor, reproducibility, privacy-conscious analytics, and operational excellence.

Requirements

• Doctorate with 1+ year data-science experience OR Master’s with 3+ years OR Bachelor’s with 5+ years in a relevant quantitative field (or equivalent experience), including managing structured/unstructured data and applying statistical techniques and reporting results.
• Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Benefits

• Certain roles may be eligible for benefits and other compensation.
• Base pay range (U.S.): USD $119,800–$234,700; San Francisco Bay Area and NYC metro: USD $160,200–$261,000.