Data Scientist II (LLM/NLP, Microsoft 365 Copilot)

Quick Facts

• Role: Data Scientist II focused on Microsoft 365 Copilot

• Focus: LLM/agentic systems, deep learning, NLP, multimodality, and model optimization

Description

Build model-driven features for Microsoft 365 Copilot Chat, taking work from concept to production. Collaborate on evaluation metrics/frameworks for LLM and agentic product performance, and prototype model approaches before selection. Develop and deploy retrieval-augmented generation workflows and contribute to improving orchestrator reasoning, latency, and multi-modality capabilities.

Responsibilities

• Define metrics and frameworks to evaluate complex AI/LLM systems and agentic product performance

• Experiment with LLMs and prompting approaches; diagnose issues and identify improvement opportunities

• Prototype and develop AI models using containerized environments; operationalize and validate scalable tools/solutions

• Develop and deploy RAG (retrieval-augmented generation) workflows, including data-source and retrieval-system selection

• Assist senior team members in assessing and refining LLM systems and models

Requirements

• Bachelor’s degree in a relevant field AND 2+ years data-science experience (or Master’s + 1+ year, or Doctorate, or equivalent)

• Experience managing structured and unstructured data and applying statistical techniques with reporting

• Ability to meet Microsoft security screening requirements, including passing the Microsoft Cloud background check

Benefits

Opportunity to help build core systems powering Microsoft 365 Copilot Chat, improving intelligence, quality, and new model-driven features.