Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering

About

Multi-hop question answering (QA) requires an information retrieval (IR) system that can find \emph{multiple} supporting evidence needed to answer the question, making the retrieval process very challenging. This paper introduces an IR technique that uses information of entities present in the initially retrieved evidence to learn to `\emph{hop}' to other relevant evidence. In a setting, with more than \textbf{5 million} Wikipedia paragraphs, our approach leads to significant boost in retrieval performance. The retrieved evidence also increased the performance of an existing QA model (without any training) on the \hotpot benchmark by \textbf{10.59} F1.

Ameya Godbole, Dilip Kavarthapu, Rajarshi Das, Zhiyu Gong, Abhishek Singhal, Hamed Zamani, Mo Yu, Tian Gao, Xiaoxiao Guo, Manzil Zaheer, Andrew McCallum• 2019

Related benchmarks

TaskDatasetResultRank
Multi-hop Question AnsweringHotpotQA fullwiki setting (test)
Answer F153.09
64
RetrievalHotpotQA full wiki (dev)--
19
Question AnsweringHotpotQA Full Wiki hidden (test)
F146.3
12
Supporting Facts PredictionHotpotQA Full Wiki hidden (test)
F1 Score43.2
11
Showing 4 of 4 rows

Other info

Follow for update