Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent

About

Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in the real world. This makes multimodal Deep Research highly challenging, as such agents require much stronger reasoning abilities in perception, logic, knowledge, and the use of more sophisticated tools compared to text-based agents. To address this limitation, we introduce WebWatcher, a multi-modal Agent for Deep Research equipped with enhanced visual-language reasoning capabilities. It leverages high-quality synthetic multimodal trajectories for efficient cold start training, utilizes various tools for deep reasoning, and further enhances generalization through reinforcement learning. To better evaluate the capabilities of multimodal agents, we propose BrowseComp-VL, a benchmark with BrowseComp-style that requires complex information retrieval involving both visual and textual information. Experimental results show that WebWatcher significantly outperforms proprietary baseline, RAG workflow and open-source agents in four challenging VQA benchmarks, which paves the way for solving complex multimodal information-seeking tasks.

Xinyu Geng, Peng Xia, Zhen Zhang, Xinyu Wang, Qiuchen Wang, Ruixue Ding, Chenxi Wang, Jialong Wu, Yida Zhao, Kuan Li, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou• 2025

Related benchmarks

TaskDatasetResultRank
Visual Question AnsweringSimpleVQA
Accuracy0.59
164
Visual Question AnsweringLiveVQA
Accuracy58.7
116
Multimodal SearchMMSearch
Accuracy55.3
85
Multimodal Search-based Question AnsweringMMSearch
Accuracy55.3
54
Multimodal Deep SearchBC-VL
Accuracy26.7
37
General Visual Question AnsweringSimpleVQA
Pass@159
33
Multimodal SearchMMSearch
Pass@155.3
25
Visual Question AnsweringBC-VL
Accuracy26.7
25
Multimodal Question AnsweringLiveVQA
Pass@158.7
24
GeolocationGeoBrowse Level 2 BrowseComp-style
City Accuracy15.8
24
Showing 10 of 30 rows

Other info

Follow for update