Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SIGHT: Reinforcement Learning with Self-Evidence and Information-Gain Diverse Branching for Search Agent

About

Reinforcement Learning (RL) has empowered Large Language Models (LLMs) to master autonomous search for complex question answering. However, particularly within multi-turn search scenarios, this interaction introduces a critical challenge: search results often suffer from high redundancy and low signal-to-noise ratios. Consequently, agents easily fall into "Tunnel Vision," where the forced interpretation of early noisy retrievals leads to irreversible error accumulation. To address these challenges, we propose SIGHT, a framework that enhances search-based reasoning through Self-Evidence Support (SES) and Information-Gain Driven Diverse Branching. SIGHT distills search results into high-fidelity evidence via SES and calculates an Information Gain score to pinpoint pivotal states where observations maximally reduce uncertainty. This score guides Dynamic Prompting Interventions - including de-duplication, reflection, or adaptive branching - to spawn new branches with SES. Finally, by integrating SES and correctness rewards via Group Relative Policy Optimization, SIGHT internalizes robust exploration strategies without external verifiers. Experiments on single-hop and multi-hop QA benchmarks demonstrate that SIGHT significantly outperforms existing approaches, particularly in complex reasoning scenarios, using fewer search steps.

Wenlin Zhong, Jinluan Yang, Yiquan Wu, Yi Liu, Jianhang Yao, Kun Kuang• 2026

Related benchmarks

TaskDatasetResultRank
Single-hop Question AnsweringTriviaQA
EM59
62
Single-hop Question AnsweringPopQA
EM43.2
55
Multi-hop Question AnsweringHotpotQA in-domain
EM46.3
20
Multi-hop Question AnsweringMulti-Hop QA Average
EM0.3775
20
Question AnsweringAll QA Datasets Average
EM40.66
20
Single-hop Question AnsweringNQ (Natural Questions) in-domain (test)
EM31.45
20
Multi-hop ReasoningMusique, HotpotQA, 2Wiki, and Bamboogle 3-hop and above
EM31.98
3
Showing 7 of 7 rows

Other info

Follow for update