Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multi-Hop Paragraph Retrieval for Open-Domain Question Answering

About

This paper is concerned with the task of multi-hop open-domain Question Answering (QA). This task is particularly challenging since it requires the simultaneous performance of textual reasoning and efficient searching. We present a method for retrieving multiple supporting paragraphs, nested amidst a large knowledge base, which contain the necessary evidence to answer a given question. Our method iteratively retrieves supporting paragraphs by forming a joint vector representation of both a question and a paragraph. The retrieval is performed by considering contextualized sentence-level representations of the paragraphs in the knowledge source. Our method achieves state-of-the-art performance over two well-known datasets, SQuAD-Open and HotpotQA, which serve as our single- and multi-hop open-domain QA benchmarks, respectively.

Yair Feldman, Ran El-Yaniv• 2019

Related benchmarks

TaskDatasetResultRank
Multi-hop Question AnsweringHotpotQA fullwiki setting (test)
Answer F140.26
64
Answer extraction and supporting sentence predictionHotpotQA fullwiki (test)
Answer EM30.6
48
Question AnsweringHotpotQA distractor (dev)
Answer F10.6532
45
Question AnsweringHotpotQA (dev)
Answer F140.4
43
Open-domain Question AnsweringSQUAD Open (test)
Exact Match39.3
39
Multi-hop Question AnsweringHotpotQA fullwiki setting (dev)
Answer F140.42
38
Question AnsweringHotpotQA (test)
Ans F140.3
37
Open-domain Question AnsweringSQuAD Open-domain 1.1 (test)
Exact Match (EM)39.3
30
Question AnsweringSQuAD-Open
EM39.3
28
Question AnsweringHotpotQA full wiki (dev)
F140.4
20
Showing 10 of 14 rows

Other info

Code

Follow for update