Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent

About

Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in the real world. This makes multimodal Deep Research highly challenging, as such agents require much stronger reasoning abilities in perception, logic, knowledge, and the use of more sophisticated tools compared to text-based agents. To address this limitation, we introduce WebWatcher, a multi-modal Agent for Deep Research equipped with enhanced visual-language reasoning capabilities. It leverages high-quality synthetic multimodal trajectories for efficient cold start training, utilizes various tools for deep reasoning, and further enhances generalization through reinforcement learning. To better evaluate the capabilities of multimodal agents, we propose BrowseComp-VL, a benchmark with BrowseComp-style that requires complex information retrieval involving both visual and textual information. Experimental results show that WebWatcher significantly outperforms proprietary baseline, RAG workflow and open-source agents in four challenging VQA benchmarks, which paves the way for solving complex multimodal information-seeking tasks.

Xinyu Geng, Peng Xia, Zhen Zhang, Xinyu Wang, Qiuchen Wang, Ruixue Ding, Chenxi Wang, Jialong Wu, Yida Zhao, Kuan Li, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou• 2025

Related benchmarks

TaskDatasetResultRank
Visual Question AnsweringLiveVQA
Accuracy58.7
108
Visual Question AnsweringSimpleVQA
Accuracy0.59
99
Multimodal Search-based Question AnsweringMMSearch
Accuracy55.3
54
Multimodal SearchMMSearch
Accuracy55.3
52
Visual Question AnsweringBC-VL
Accuracy26.7
25
GeolocationGeoBrowse Level 2 BrowseComp-style
City Accuracy15.8
24
GeolocationGeoBrowse Level 1 Visual Cues
City Accuracy7.7
24
Agentic SearchMMSearch v1.0 (test)
Accuracy55.3
21
Multimodal SearchMMSearch
Success Rate55.3
19
Agentic SearchBC-VL
Accuracy27
18
Showing 10 of 17 rows

Other info

Follow for update