Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cog-RAG: Cognitive-Inspired Dual-Hypergraph with Theme Alignment Retrieval-Augmented Generation

About

Retrieval-Augmented Generation (RAG) enhances the response quality and domain-specific performance of large language models (LLMs) by incorporating external knowledge to combat hallucinations. In recent research, graph structures have been integrated into RAG to enhance the capture of semantic relations between entities. However, it primarily focuses on low-order pairwise entity relations, limiting the high-order associations among multiple entities. Hypergraph-enhanced approaches address this limitation by modeling multi-entity interactions via hyperedges, but they are typically constrained to inter-chunk entity-level representations, overlooking the global thematic organization and alignment across chunks. Drawing inspiration from the top-down cognitive process of human reasoning, we propose a theme-aligned dual-hypergraph RAG framework (Cog-RAG) that uses a theme hypergraph to capture inter-chunk thematic structure and an entity hypergraph to model high-order semantic relations. Furthermore, we design a cognitive-inspired two-stage retrieval strategy that first activates query-relevant thematic content from the theme hypergraph, and then guides fine-grained recall and diffusion in the entity hypergraph, achieving semantic alignment and consistent generation from global themes to local details. Our extensive experiments demonstrate that Cog-RAG significantly outperforms existing state-of-the-art baseline approaches.

Hao Hu, Yifan Feng, Ruoxue Li, Rundong Xue, Xingliang Hou, Zhiqiang Tian, Yue Gao, Shaoyi Du• 2025

Related benchmarks

TaskDatasetResultRank
Multi-hop Question AnsweringHotpotQA (test)
F144.1
311
Multi-hop Question AnsweringMuSiQue (test)
F126.6
128
Fact VerificationMINE
Accuracy80.2
28
Explanatory QAPathology (test)
EM78.9
10
Question AnsweringUltraDomain Computer Science 1.0
EM25.39
10
Question AnsweringUltraDomain Legal 1.0
EM22.65
10
Explanatory QAMix (test)
EM73.7
10
Question AnsweringUltraDomain Agriculture 1.0
Exact Match (EM)17.57
10
Question AnsweringOverall Average (test)
EM42.3
10
Question AnsweringUltraDomain Mix 1.0 (512 question-answer pairs)
Exact Match (EM)29.88
10
Showing 10 of 17 rows

Other info

Follow for update