Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GeAR: Graph-enhanced Agent for Retrieval-augmented Generation

About

Retrieval-augmented Generation (RAG) relies on effective retrieval capabilities, yet traditional sparse and dense retrievers inherently struggle with multi-hop retrieval scenarios. In this paper, we introduce GeAR, a system that advances RAG performance through two key innovations: (i) an efficient graph expansion mechanism that augments any conventional base retriever, such as BM25, and (ii) an agent framework that incorporates the resulting graph-based retrieval into a multi-step retrieval framework. Our evaluation demonstrates GeAR's superior retrieval capabilities across three multi-hop question answering datasets. Notably, our system achieves state-of-the-art results with improvements exceeding 10% on the challenging MuSiQue dataset, while consuming fewer tokens and requiring fewer iterations than existing multi-step retrieval systems. The project page is available at https://gear-rag.github.io.

Zhili Shen, Chenxin Diao, Pavlos Vougiouklis, Pascual Merita, Shriram Piramanayagam, Enting Chen, Damien Graux, Andre Melo, Ruofei Lai, Zeren Jiang, Zhongyang Li, YE QI, Yang Ren, Dandan Tu, Jeff Z. Pan• 2024

Related benchmarks

TaskDatasetResultRank
Multi-hop Question Answering2WikiMultihopQA
EM47.4
278
Multi-hop Question AnsweringHotpotQA
F1 Score54.6
221
Multi-hop Question AnsweringMulti-hop RAG
F152.5
65
Long-Horizon AssemblyLong-Horizon Assembly Simulation
TSR0.00e+0
7
Exploration & Q&ALarge-Scale Facility Simulation
PE240
4
Dynamic RecoveryReal-World Dynamic Recovery Task 3 N=60 (test)
TSR0.00e+0
4
Showing 6 of 6 rows

Other info

Follow for update