Data Scientist II

Position Overview

At LivePerson, the Data Scientist II helps advance Conversational AI by applying research and experimentation with Large Language Models (LLMs) to real-world customer interactions. This role designs and executes applied research initiatives, develops effective prompting and orchestration strategies using deep knowledge of transformer architectures, and optimizes modern LLM inference and retrieval pipelines. The scientist analyzes large-scale conversational datasets to improve Retrieval-Augmented Generation (RAG) systems and builds robust experimentation frameworks for evaluating non-deterministic model outputs. Working closely with other scientists and cross-functional teams, this role translates insights on model behavior into recommendations that inform product and business strategy while staying at the forefront of Generative AI advancements.

Key Responsibilities & Impact

• Propose, plan, and execute applied research initiatives using Large Language Models (LLMs) in a commercial setting.
• Apply expert knowledge of Transformer architecture mechanics (Attention, Tokenization, Embeddings) to develop effective and explainable prompting and orchestration approaches.
• Utilize modern LLM inference and retrieval pipelines.
• Analyze large-scale conversational datasets for RAG optimization.
• Implement research-driven prompt strategies within production systems.
• Create flexible scientific evaluation frameworks for non-deterministic model outputs.
• Present findings on model behavior and context efficacy to guide product and business strategy.
• Collaborate closely with other scientists.
• Stay current with advancements in Generative AI.

Required Skills & Qualifications

• Master’s degree in Computer Science, Artificial Intelligence, Computational Linguistics, Operations Research, Industrial Engineering, or related field plus two (2) years of experience as a data scientist.
• Two (2) years of experience in:
  • Python programming
  • Designing LLM interaction flows, evaluation frameworks, or advanced prompting strategies
  • Deploying GenAI/LLM solutions into production with engineering teams
• One (1) year of experience in:
  • Generative AI, LLMs, RAG, and Semantic Search/Vector Databases
  • Advanced prompting techniques (Chain-of-Thought, Few-Shot)
  • Dialogue systems and context management
  • LLM orchestration frameworks (LangChain / LangGraph)
  • Transformer architectures (Attention mechanisms, Context Windows, Tokenization constraints)
  • SQL

Salary range: $120,000 to $145,000 USD. Final compensation is based on location, skills, experience, education, and certifications.

Our Benefits & Perks

Health & Wellbeing

• Medical, Dental, and Vision Insurance
• Wellness resources and Employee Assistance Program (EAP)

Financial Security & Growth

• 401(k) Retirement Plan with 4% employer match
• HSA & FSA plans
• Employee Stock Purchase Program (ESPP)
• Life, AD&D, disability, legal, identity theft, and critical illness insurance
• Professional development resources

Time Away & Family Support

• Flexible Paid Time Off (PTO)
• Paid public holidays
• Generous parental leave policy

Workplace Flexibility

• Fully remote role with optional WeWork space access