VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
About
Video understanding is moving beyond closed-context perception toward open-world evidence exploration, a paradigm formalized as Video Deep Research (VDR). However, existing multimodal search agents primarily target static images, and the current VDR benchmark relies on text-centric retrieval that discards crucial visual information. To address these limitations, we propose VideoSearcher, a closed-loop agentic framework that empowers Vision-Language Models with multi-tool reasoning for VDR. VideoSearcher unifies temporal localization, spatial focusing, and multimodal search within a single reasoning trajectory, enabling agents to progressively ground visual clues, retrieve relevant evidence, and synthesize answers. To optimize knowledge-intensive reasoning trajectories, we propose Bi-branch Sequence Policy Optimization (BiSPO), a reinforcement learning algorithm that decouples tool-invocation optimization from answer-accuracy optimization. This design provides stable learning signals for both evidence-grounded reasoning and purposeful tool use. Furthermore, we construct VideoSearch-QA, the first benchmark designed to evaluate open-world video information grounding and multimodal search-based reasoning. Extensive experiments demonstrate that VideoSearcher significantly outperforms prior open-source agentic baselines across various search-oriented and multimodal understanding benchmarks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Temporal Video Understanding | TempCompass | Accuracy73.14 | 160 | |
| Visual Question Answering | LiveVQA | -- | 151 | |
| Video Understanding | MMVU | Accuracy70.4 | 91 | |
| Video Understanding | VideoMMMU | Accuracy66.33 | 67 | |
| Visual Question Answering | SimpleVQA | Score67.2 | 38 | |
| Multi-modal Search | MMSearch | Score67.84 | 24 | |
| High-Resolution Multi-modal Search | HR-MMSearch | Score43.61 | 24 | |
| Fact-based Visual Question Answering | FVQA (test) | Score64.1 | 24 | |
| Information Seeking | InfoSeek | Score58.3 | 24 | |
| Video Deep Research | VideoDR | Score53 | 24 |