Senior Deep Learning Scientist, Multimodal Agentic RL

Quick Facts

• Role: Senior Deep Learning Scientist (Multimodal Agentic RL)

Description

You will apply fundamental and applied research to build, train, fine-tune, and deploy large language models for agentic systems that perform audio-visual reasoning, tool usage, and document understanding. You will advance post-training and alignment methods—such as instruction tuning, preference optimization, and RLHF/RLVR/MOPD—to improve multimodal agents for complex real-world use cases. You will also research agentic reasoning and grounded perception, and lead multimodal dataset collection, development, and benchmarking for accuracy, safety, and task completion.

Responsibilities

• Develop and deploy large language models for agentic multimodal systems (audio-visual reasoning, tool use, document understanding)
• Improve agents via post-training and alignment methods (instruction tuning, preference optimization, RLHF/RLVR/MOPD)
• Research planning, tool execution, and long-horizon task completion in digital and physical environments
• Collect, develop, and benchmark multimodal datasets to evaluate accuracy, safety, and task success

Requirements

• Master’s degree (or equivalent) or PhD in Computer Science, AI, or Applied Math with 5+ years of relevant experience
• Excellent Python programming skills and strong fundamentals for scalable model development using deep learning frameworks like PyTorch
• Strong knowledge of ML/DL techniques and modern foundation model architectures (Transformers, mixture-of-experts)
• Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design
• Hands-on experience in post-training multimodal models for omni-modality reasoning, full-duplex voice chat, and human-AI interaction
• Proven ability to manage the model development lifecycle (dataset versioning, experiment tracking, evaluation pipelines)

Benefits

• Highly competitive salary and comprehensive benefits package
• Eligibility for equity and additional benefits
• Base salary range: 152,000–241,500 USD (Level 3) or 184,000–287,500 USD (Level 4)
• Opportunities for state-of-the-art, high-impact multimodal AI research