Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DioR: Adaptive Cognitive Detection and Contextual Retrieval Optimization for Dynamic Retrieval-Augmented Generation

About

Dynamic Retrieval-augmented Generation (RAG) has shown great success in mitigating hallucinations in large language models (LLMs) during generation. However, existing dynamic RAG methods face significant limitations in two key aspects: 1) Lack of an effective mechanism to control retrieval triggers, and 2) Lack of effective scrutiny of retrieval content. To address these limitations, we propose an innovative dynamic RAG method, DioR (Adaptive Cognitive Detection and Contextual Retrieval Optimization), which consists of two main components: adaptive cognitive detection and contextual retrieval optimization, specifically designed to determine when retrieval is needed and what to retrieve for LLMs is useful. Experimental results demonstrate that DioR achieves superior performance on all tasks, demonstrating the effectiveness of our work.

Hanghui Guo, Jia Zhu, Shimin Di, Weijie Shi, Zhangze Chen, Jiajie Xu• 2025

Related benchmarks

TaskDatasetResultRank
Question AnsweringSQuAD (test)
F127.8
156
Question AnsweringHotpotQA
F137.9
132
Question Answering2WikiMultiHopQA (test)
F129.02
113
Question Answering2WikiMultihopQA
EM26.6
107
Question AnsweringNatural Questions (NQ) (test)
Exact Match26.2
77
Question AnsweringHotpotQA
Recall38.1
42
Question AnsweringStrategyQA
EM65.9
21
Question AnsweringHotpotQA (test)
F10.2548
18
Question AnsweringIIRC
EM20.1
15
Question AnsweringStrategyQA
Precision65.9
9
Showing 10 of 11 rows

Other info

Follow for update