Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis

About

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical limitations that lack high-quality training trajectories or suffer from the distributional mismatches in simulated environments and prohibitive computational costs for real-world deployment. This paper introduces SimpleDeepSearcher, a lightweight yet effective framework that bridges this gap through strategic data engineering rather than complex training paradigms. Our approach synthesizes high-quality training data by simulating realistic user interactions in live web search environments, coupled with a multi-criteria curation strategy that optimizes the diversity and quality of input and output side. Experiments on five benchmarks across diverse domains demonstrate that SFT on only 871 curated samples yields significant improvements over RL-based baselines. Our work establishes SFT as a viable pathway by systematically addressing the data-scarce bottleneck, offering practical insights for efficient deep search systems. Our code is available at https://github.com/RUCAIBox/SimpleDeepSearcher.

Shuang Sun, Huatong Song, Yuhao Wang, Ruiyang Ren, Jinhao Jiang, Junjie Zhang, Fei Bai, Jia Deng, Wayne Xin Zhao, Zheng Liu, Lei Fang, Zhongyuan Wang, Ji-Rong Wen• 2025

Related benchmarks

TaskDatasetResultRank
Multi-hop Question Answering2WikiMultihopQA
EM77.9
387
Multi-hop Question AnsweringMuSiQue
EM32.3
185
Multi-hop Question AnsweringBamboogle
EM76.5
51
Question AnsweringGPQA
EM46.6
34
Question AnsweringQASPER 1200:251 (test)
Answerable EM22.92
20
Question AnsweringHotpotQA 296:204 (test)
Answerable EM45.61
20
Question AnsweringGAIA
Accuracy (Pass@4)45.2
18
Advanced Question AnsweringWebWalkerQA
Exact Match42.4
14
Multi-hop Question AnsweringBamboogle
LJFT Score61.6
5
Multi-hop Question AnsweringBrowseComp-ZH
LJFT7.27
5
Showing 10 of 13 rows

Other info

Follow for update