Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SemFlowRAG: Directed Semantic Flow from Abstraction to Evidence for Complex Reasoning

About

Retrieval-Augmented Generation (RAG) enhanced by Knowledge Graphs has shown promise in complex multi-hop reasoning tasks. However, existing graph-based retrieval methods typically rely on flat, undirected topologies. During the retrieval process, the probability flow often gets trapped in high-degree abstract concept nodes which we define as ``probability black holes'', leading to semantic drift and noise accumulation. To address this, we propose SemFlowRAG, a framework that reconstructs the flat retrieval space into a corpus-adaptive semantic gradient graph. This data-driven self-organization enables a hierarchical structure to emerge naturally from the data distribution, capturing the intrinsic semantic granularity of the corpus to suppress structural noise. By quantifying the semantic abstractness of entities through the embedding variance of their associated passages, we transform static undirected edges into directed semantic constraints. Furthermore, we design an abstractness-guided directed PageRank algorithm that forces the retrieval trajectory to follow a ``high-to-low semantic abstractness'' gradient. This mechanism ensures layer-by-layer evidence convergence, smoothly guiding the retrieval process from abstract concepts to specific document evidence. Extensive experiments on complex QA datasets demonstrate that SemFlowRAG effectively mitigates the ``probability black holes'' issue, outperforming existing baselines in both retrieval and downstream reasoning performance.

Houyuan Qin, Rong Wu, Qinyuan Qin, Botian Shi, Jingjing Qu, Yang Sun, Pinlong Cai• 2026

Related benchmarks

TaskDatasetResultRank
Document RetrievalMuSiQue (test)--
61
Passage retrievalNatural Questions (NQ) (test)--
45
RetrievalHotpotQA (test)
Recall@596.1
31
Simple Question AnsweringPopQA
F156.2
26
Discourse Question AnsweringNarrativeQA
F1 Score26.6
14
General Question AnsweringAggregated Benchmarks Average
Average F161.2
14
Multi-hop Question AnsweringMuSiQue
F1 Score (MuSiQue)51.4
14
Simple Question AnsweringNQ
F1 Score62.3
14
Passage retrieval2Wiki (test)
Recall@594.8
11
Passage retrievalPopQA (test)
Recall@552.8
11
Showing 10 of 10 rows

Other info

Follow for update