Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EfficientRAG: Efficient Retriever for Multi-Hop Question Answering

About

Retrieval-augmented generation (RAG) methods encounter difficulties when addressing complex questions like multi-hop queries. While iterative retrieval methods improve performance by gathering additional information, current approaches often rely on multiple calls of large language models (LLMs). In this paper, we introduce EfficientRAG, an efficient retriever for multi-hop question answering. EfficientRAG iteratively generates new queries without the need for LLM calls at each iteration and filters out irrelevant information. Experimental results demonstrate that EfficientRAG surpasses existing RAG methods on three open-domain multi-hop question-answering datasets.

Ziyuan Zhuang, Zhiyang Zhang, Sitao Cheng, Fangkai Yang, Jia Liu, Shujian Huang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Multi-hop Question Answering2WikiMultihopQA
EM47.7
387
Multi-hop Question AnsweringHotpotQA
F1 Score57.9
294
Multi-hop Question AnsweringMulti-hop RAG
F155.3
77
Multi-hop Question AnsweringMuSiQue
Accuracy46.42
24
Multi-hop Retrieval-Augmented GenerationMHR NewsAgent Source
Accuracy81.8
8
Multi-hop Question AnsweringHotpotQA
LM Score57.41
6
Multi-hop Question Answering2WikiMultihopQA
LM Score69.41
6
Question AnsweringNatural Questions (NQ)
LM Score62.73
6
Showing 8 of 8 rows

Other info

Follow for update