Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Search-o1: Agentic Search-Enhanced Large Reasoning Models

About

Large reasoning models (LRMs) like OpenAI-o1 have demonstrated impressive long stepwise reasoning capabilities through large-scale reinforcement learning. However, their extended reasoning processes often suffer from knowledge insufficiency, leading to frequent uncertainties and potential errors. To address this limitation, we introduce \textbf{Search-o1}, a framework that enhances LRMs with an agentic retrieval-augmented generation (RAG) mechanism and a Reason-in-Documents module for refining retrieved documents. Search-o1 integrates an agentic search workflow into the reasoning process, enabling dynamic retrieval of external knowledge when LRMs encounter uncertain knowledge points. Additionally, due to the verbose nature of retrieved documents, we design a separate Reason-in-Documents module to deeply analyze the retrieved information before injecting it into the reasoning chain, minimizing noise and preserving coherent reasoning flow. Extensive experiments on complex reasoning tasks in science, mathematics, and coding, as well as six open-domain QA benchmarks, demonstrate the strong performance of Search-o1. This approach enhances the trustworthiness and applicability of LRMs in complex reasoning tasks, paving the way for more reliable and versatile intelligent systems. The code is available at \url{https://github.com/sunnynexus/Search-o1}.

Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, Zhicheng Dou• 2025

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningGSM8K
Accuracy73.8
1362
Mathematical ReasoningMATH
Accuracy78.2
882
Mathematical ReasoningMATH500 (test)--
514
Multi-hop Question Answering2WikiMultihopQA
EM58
387
Multi-hop Question AnsweringHotpotQA
F1 Score57.3
294
Multi-hop Question AnsweringHotpotQA (test)
F118.7
255
Multi-hop Question Answering2WikiMultiHopQA (test)
EM62.9
195
Question AnsweringPopQA--
186
Multi-hop Question AnsweringMuSiQue
EM21.6
185
Question AnsweringTriviaQA
EM54.8
182
Showing 10 of 219 rows
...

Other info

Code

Follow for update