Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis

About

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical limitations that lack high-quality training trajectories or suffer from the distributional mismatches in simulated environments and prohibitive computational costs for real-world deployment. This paper introduces SimpleDeepSearcher, a lightweight yet effective framework that bridges this gap through strategic data engineering rather than complex training paradigms. Our approach synthesizes high-quality training data by simulating realistic user interactions in live web search environments, coupled with a multi-criteria curation strategy that optimizes the diversity and quality of input and output side. Experiments on five benchmarks across diverse domains demonstrate that SFT on only 871 curated samples yields significant improvements over RL-based baselines. Our work establishes SFT as a viable pathway by systematically addressing the data-scarce bottleneck, offering practical insights for efficient deep search systems. Our code is available at https://github.com/RUCAIBox/SimpleDeepSearcher.

Shuang Sun, Huatong Song, Yuhao Wang, Ruiyang Ren, Jinhao Jiang, Junjie Zhang, Fei Bai, Jia Deng, Wayne Xin Zhao, Zheng Liu, Lei Fang, Zhongyuan Wang, Ji-Rong Wen• 2025

Related benchmarks

TaskDatasetResultRank
Question AnsweringQASPER 1200:251 (test)
Answerable EM22.92
20
Question AnsweringHotpotQA 296:204 (test)
Answerable EM45.61
20
Multi-hop Question AnsweringBamboogle
LJFT Score61.6
5
Multi-hop Question AnsweringBrowseComp-ZH
LJFT7.27
5
Multi-hop Question AnsweringWeb Dancer
LJFT44.67
5
Multi-hop Question AnsweringAverage (BrowseComp-ZH, Bamboogle, MuSiQue, Web Dancer) (Overall)
LJFT Score33.68
5
Multi-hop Question AnsweringMuSiQue
LJFT21.2
5
Showing 7 of 7 rows

Other info

Follow for update