VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research
cs.AI, cs.CV
Submitted: 2026-10-04
Updated: 2026-10-04
Code: https://github.com/Ralph-Zhou/VideoResearchAgent
License: http://creativecommons.org/licenses/by/4.0/
The gist: Existing deep research agents are designed primarily for text- and image-based web sources, while video reasoning systems typically assume that relevant videos are provided in advance.
Abstract
Existing deep research agents are designed primarily for text- and image-based web sources, while video reasoning systems typically assume that relevant videos are provided in advance. We study open-web video research, where an agent must autonomously discover relevant videos, navigate their temporal content, and ground answers in visual evidence. Training such agents at scale is challenging as live video interaction is slow and unreliable, whereas fixed local simulation can induce retrieval-specific shortcuts that fail to transfer to the open web. We introduce VideoResearchAgent, a scalable training framework to address these challenges. First, we introduce controllable task synthesis pipeline to synthesize multi-hop research tasks from timestamped visual evidence while filtering text-only shortcuts. Second, we build a field-aligned local video simulator that preserves deployment-facing search and watch interactions while accelerating video search by a factor of 34.5-64.6. Third, we introduce Retrieval-Domain-Randomized GRPO (RDR-GRPO), which diversifies candidate rankings, distractors, metadata, and result structure during training to reduce overfitting to simulated retrieval. On Video-BrowseComp, the VideoResearchAgent trained using Qwen3.5-4B achieves 40.48% accuracy, comparable to Gemini-3-Flash-Preview, while reducing cumulative API-token consumption by 74.9% relative to the untrained model. Together, these results establish an accurate and efficient training recipe for open-web video research.
Sources
- REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agents
- OpenSeeker-v2: Pushing the Limits of Search Agents with Informative and High-Difficulty Trajectories
- OpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Data
- Video-R1: Reinforcing Video Reasoning in MLLMs
- Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
- InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search
- Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Models
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
- WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learning
- WebSailor: Navigating Super-human Reasoning for Web Agent
- MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents
- Video-Browser: Towards Open-web Agentic Video Browsing
- VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking
- Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection
- POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management
- Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexity
- DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- ViDR: Grounding Multimodal Deep Research Reports in Source Visual Evidence
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems