Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval

About

We propose a simple and efficient multi-hop dense retrieval approach for answering complex open-domain questions, which achieves state-of-the-art performance on two multi-hop datasets, HotpotQA and multi-evidence FEVER. Contrary to previous work, our method does not require access to any corpus-specific information, such as inter-document hyperlinks or human-annotated entity markers, and can be applied to any unstructured text corpus. Our system also yields a much better efficiency-accuracy trade-off, matching the best published accuracy on HotpotQA while being 10 times faster at inference time.

Wenhan Xiong, Xiang Lorraine Li, Srini Iyer, Jingfei Du, Patrick Lewis, William Yang Wang, Yashar Mehdad, Wen-tau Yih, Sebastian Riedel, Douwe Kiela, Barlas O\u{g}uz• 2020

Related benchmarks

TaskDatasetResultRank
Multi-hop Question AnsweringHotpotQA (test)--
311
Multi-hop Question AnsweringMuSiQue (test)--
128
RetrievalHotpotQA--
68
Multi-hop Question AnsweringHotpotQA fullwiki setting (test)
Answer F175.3
64
Answer extraction and supporting sentence predictionHotpotQA fullwiki (test)
Answer EM62.3
48
Question AnsweringHotpotQA (dev)
Answer F175.1
43
Multi-hop Question AnsweringHotpotQA fullwiki setting (dev)
Answer F175.6
38
Question AnsweringHotpotQA (test)
Ans EM62.3
37
Multi-hop QA Retrieval2WikiMultiHopQA (test)--
33
Page-level retrievalKILT (test)
WoW Score36.5
28
Showing 10 of 30 rows

Other info

Code

Follow for update