Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification

About

Test-time compute can be scaled both sequentially and in parallel. Sequential scaling involves lengthening the generation process, while parallel scaling involves verifying and selecting among multiple candidate outputs. Combining these two strategies has led to the most powerful AI systems, such as Grok 4 Heavy and GPT-5 Pro. In certain contexts (e.g., solving Sudoku puzzles), verifying responses can be substantially easier than generating them. This property, referred to as \emph{asymmetric verification}, highlights the strong potential of test-time scaling (TTS). In this work, we study both sequential and parallel TTS of deep search agents, motivated by the intuition that verification in this setting is often much easier than generation. In experiments, we first show that sequential scaling methods, such as budget forcing, can be effective initially but soon degrade performance. Leveraging asymmetric verification, however, we are able to achieve substantial improvements by allocating only a modest amount of compute to the verifier. We conduct experiments with flagship open-source models and extend them to their ``Heavy'' variants through TTS. These deep research agents achieve gains of up to 27 absolute points on benchmarks such as BrowseComp. Remarkably, as an open-source alternative, GLM-4.5 Heavy reaches accuracy of {\bf 54.0\%} on BrowseComp and {\bf 66.0\%} on GAIA, placing it comparable to the best proprietary choices such as OpenAI Deep Research. Tongyi-DeepResearch Heavy further achieves {\bf 69.0\%} accuracy on BrowseComp, greatly surpassing the best proprietary results.

Weihao Zeng, Keqing He, Chuqiao Kuang, Xiaoguang Li, Junxian He• 2025

Related benchmarks

TaskDatasetResultRank
General AI Assistant TasksGAIA
Accuracy72.8
291
Web BrowsingBrowsecomp
Accuracy69
68
Web BrowsingBrowseComp-ZH
Accuracy55
34
Agentic SearchDeepSearchQA
Accuracy89.5
14
Agentic Searchxbench DeepSearch
Accuracy58
14
Agentic SearchGAIA Search
Accuracy95.3
14
Agentic SearchBrowseComp+
Accuracy63
14
Showing 7 of 7 rows

Other info

Follow for update