SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis
About
Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical limitations that lack high-quality training trajectories or suffer from the distributional mismatches in simulated environments and prohibitive computational costs for real-world deployment. This paper introduces SimpleDeepSearcher, a lightweight yet effective framework that bridges this gap through strategic data engineering rather than complex training paradigms. Our approach synthesizes high-quality training data by simulating realistic user interactions in live web search environments, coupled with a multi-criteria curation strategy that optimizes the diversity and quality of input and output side. Experiments on five benchmarks across diverse domains demonstrate that SFT on only 871 curated samples yields significant improvements over RL-based baselines. Our work establishes SFT as a viable pathway by systematically addressing the data-scarce bottleneck, offering practical insights for efficient deep search systems. Our code is available at https://github.com/RUCAIBox/SimpleDeepSearcher.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Question Answering | QASPER 1200:251 (test) | Answerable EM22.92 | 20 | |
| Question Answering | HotpotQA 296:204 (test) | Answerable EM45.61 | 20 | |
| Multi-hop Question Answering | Bamboogle | LJFT Score61.6 | 5 | |
| Multi-hop Question Answering | BrowseComp-ZH | LJFT7.27 | 5 | |
| Multi-hop Question Answering | Web Dancer | LJFT44.67 | 5 | |
| Multi-hop Question Answering | Average (BrowseComp-ZH, Bamboogle, MuSiQue, Web Dancer) (Overall) | LJFT Score33.68 | 5 | |
| Multi-hop Question Answering | MuSiQue | LJFT21.2 | 5 |