Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering
About
Multi-hop question answering (QA) requires an information retrieval (IR) system that can find \emph{multiple} supporting evidence needed to answer the question, making the retrieval process very challenging. This paper introduces an IR technique that uses information of entities present in the initially retrieved evidence to learn to `\emph{hop}' to other relevant evidence. In a setting, with more than \textbf{5 million} Wikipedia paragraphs, our approach leads to significant boost in retrieval performance. The retrieved evidence also increased the performance of an existing QA model (without any training) on the \hotpot benchmark by \textbf{10.59} F1.
Ameya Godbole, Dilip Kavarthapu, Rajarshi Das, Zhiyu Gong, Abhishek Singhal, Hamed Zamani, Mo Yu, Tian Gao, Xiaoxiao Guo, Manzil Zaheer, Andrew McCallum• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-hop Question Answering | HotpotQA fullwiki setting (test) | Answer F153.09 | 64 | |
| Retrieval | HotpotQA full wiki (dev) | -- | 19 | |
| Question Answering | HotpotQA Full Wiki hidden (test) | F146.3 | 12 | |
| Supporting Facts Prediction | HotpotQA Full Wiki hidden (test) | F1 Score43.2 | 11 |
Showing 4 of 4 rows