Multi-Hop Paragraph Retrieval for Open-Domain Question Answering
About
This paper is concerned with the task of multi-hop open-domain Question Answering (QA). This task is particularly challenging since it requires the simultaneous performance of textual reasoning and efficient searching. We present a method for retrieving multiple supporting paragraphs, nested amidst a large knowledge base, which contain the necessary evidence to answer a given question. Our method iteratively retrieves supporting paragraphs by forming a joint vector representation of both a question and a paragraph. The retrieval is performed by considering contextualized sentence-level representations of the paragraphs in the knowledge source. Our method achieves state-of-the-art performance over two well-known datasets, SQuAD-Open and HotpotQA, which serve as our single- and multi-hop open-domain QA benchmarks, respectively.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-hop Question Answering | HotpotQA fullwiki setting (test) | Answer F140.26 | 64 | |
| Answer extraction and supporting sentence prediction | HotpotQA fullwiki (test) | Answer EM30.6 | 48 | |
| Question Answering | HotpotQA distractor (dev) | Answer F10.6532 | 45 | |
| Question Answering | HotpotQA (dev) | Answer F140.4 | 43 | |
| Open-domain Question Answering | SQUAD Open (test) | Exact Match39.3 | 39 | |
| Multi-hop Question Answering | HotpotQA fullwiki setting (dev) | Answer F140.42 | 38 | |
| Question Answering | HotpotQA (test) | Ans F140.3 | 37 | |
| Open-domain Question Answering | SQuAD Open-domain 1.1 (test) | Exact Match (EM)39.3 | 30 | |
| Question Answering | SQuAD-Open | EM39.3 | 28 | |
| Question Answering | HotpotQA full wiki (dev) | F140.4 | 20 |