Senior Deep Learning Scientist, Multimodal Agentic Reinforcement Learning

Quick Facts

• Role: Senior Deep Learning Scientist (Multimodal Agentic RL)
• Focus: Streaming and agentic multimodal AI; multimodal foundation models for reasoning, planning, and acting

Description

Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems spanning audio-visual reasoning, tool usage, and document understanding. Advance multimodal post-training and alignment methods (instruction tuning, preference optimization, and RLHF/RLVR/MOPD) and develop agentic reasoning and grounded perception for long-horizon tasks in digital and physical environments. Lead the collection, development, and benchmarking of multimodal datasets to improve accuracy, safety, and task completion success.

Responsibilities

• Develop and fine-tune large language models for agentic audio-visual reasoning, tool usage, and document understanding
• Improve multimodal agents via post-training and alignment methods (instruction tuning, preference optimization, RLHF/RLVR/MOPD)
• Research agentic reasoning and grounded perception: planning, tool execution, and long-horizon task completion
• Collect, build, and benchmark multimodal datasets for accuracy, safety, and success metrics

Requirements

• Master’s degree (or equivalent) or PhD in Computer Science, AI, or Applied Math with 8+ years of relevant experience
• Excellent Python programming skills for scalable model development and deep learning frameworks
• Strong ML/DL knowledge including Transformers and mixture-of-experts foundation model architectures
• Foundational reinforcement learning understanding and implementation (MDPs, policies, reward design)
• Hands-on experience in post-training multimodal omni-modality (audio-visual) reasoning and voice interaction
• Proven ability to manage model development life cycles (dataset versioning, experiment tracking, evaluation pipelines)

Benefits

• Highly competitive salary and comprehensive benefits package
• Base salary range: 184,000 USD – 287,500 USD (varies by location and experience)
• Eligible for equity and additional benefits