Senior Deep Learning Scientist, Multimodal Agentic RL

Quick Facts

• Senior role focused on multimodal agentic AI research and model development
• Work spans large language models, audio-visual reasoning, reinforcement learning, and post-training/alignment

Description

Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems with audio-visual reasoning, tool usage, and document understanding. Advance post-training and alignment methods (including instruction tuning and preference optimization) and develop grounded perception and agentic reasoning for long-horizon tasks. Lead the collection, development, and benchmarking of multimodal datasets to improve model accuracy, safety, and task completion success.

Responsibilities

• Develop and train large language models for agentic systems (audio-visual reasoning, tool use, document understanding)
• Improve multimodal agents via post-training/alignment (instruction tuning, preference optimization, RLHF/RLVR/MOPD)
• Research grounded perception and agentic reasoning (planning, tool execution, long-horizon task completion in digital/physical settings)
• Collect, develop, and benchmark multimodal datasets; evaluate accuracy, safety, and success rates

Requirements

• Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math with 8+ years of relevant work experience
• Excellent Python programming skills for scalable model development and deep learning frameworks such as PyTorch
• Strong knowledge of ML/DL and modern foundation model architectures (Transformers, mixture-of-experts)
• Foundational reinforcement learning knowledge including MDPs, policies, and reward design
• Hands-on experience in post-training multimodal models for omni-modality (audio-visual) reasoning and full-duplex voice chat
• Proven ability to manage model development lifecycles including dataset versioning, experiment tracking, and evaluation pipelines

Benefits

• Highly competitive salary (base range: $184,000–$287,500 USD)
• Equity eligibility and comprehensive benefits package