Data Scientist III

Quick Facts

• Role: Data Scientist III (hands-on enterprise AI)

Description

You will design, develop, evaluate, and improve AI/ML solutions for enterprise business and technical challenges, using statistical rigor, reproducible experimentation, and MLOps/LLMOps practices. The work spans traditional ML, generative AI, Retrieval-Augmented Generation (RAG), model evaluation, and applied AI experimentation.

Responsibilities

• Apply classification, regression, ranking, forecasting, clustering, and anomaly detection to enterprise AI and agentic use cases

• Build and evaluate intent classification, semantic matching, agent/skill/tool ranking, and model-routing using traditional ML, embeddings, and LLM-based approaches

• Use statistical modeling to analyze execution latency, token usage, inference costs, workload trends, and resource requirements

• Evaluate and benchmark foundation models for accuracy, instruction adherence, structured outputs, latency, and cost

• Develop and evaluate RAG pipelines: document chunking, metadata, embeddings, retrieval, reranking, and context selection

• Support fine-tuning and adaptation (including prompting, RAG, supervised instruction fine-tuning, and parameter-efficient approaches such as LoRA/QLoRA)

• Apply evaluation methods for agentic AI, including planning, tool calling, routing, parameter extraction, and recovery behavior

• Create evaluation datasets, golden test cases, holdouts, and automated evaluation workflows; apply statistical analysis, human evaluation, and LLM-as-judge approaches with calibration

• Track metrics such as accuracy, relevance, groundedness, instruction following, task completion, latency, and cost; investigate evaluation failures and recommend improvements

• Execute MLOps/LLMOps practices: experiment tracking/versioning across datasets, code, model configs, prompts, and retrieval settings; use model registries; run quality gates, regression testing, and production readiness validation; collaborate on monitoring and lifecycle management

Benefits

• Annual base salary range: $131,700–$219,500 (actual pay depends on factors such as skills and experience)

• Additional rewards may include variable plans and country-specific benefits