Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval

About

We propose a simple and efficient multi-hop dense retrieval approach for answering complex open-domain questions, which achieves state-of-the-art performance on two multi-hop datasets, HotpotQA and multi-evidence FEVER. Contrary to previous work, our method does not require access to any corpus-specific information, such as inter-document hyperlinks or human-annotated entity markers, and can be applied to any unstructured text corpus. Our system also yields a much better efficiency-accuracy trade-off, matching the best published accuracy on HotpotQA while being 10 times faster at inference time.

Wenhan Xiong, Xiang Lorraine Li, Srini Iyer, Jingfei Du, Patrick Lewis, William Yang Wang, Yashar Mehdad, Wen-tau Yih, Sebastian Riedel, Douwe Kiela, Barlas O\u{g}uz• 2020

Related benchmarks

TaskDatasetResultRank
Multi-hop Question AnsweringHotpotQA (test)--
198
Multi-hop Question AnsweringHotpotQA fullwiki setting (test)
Answer F175.3
64
Answer extraction and supporting sentence predictionHotpotQA fullwiki (test)
Answer EM62.3
48
Question AnsweringHotpotQA (dev)
Answer F175.1
43
Multi-hop Question AnsweringHotpotQA fullwiki setting (dev)
Answer F175.6
38
Question AnsweringHotpotQA (test)
Ans F175.3
37
Page-level retrievalKILT (test)
WoW Score36.5
28
RetrievalHotpotQA--
24
Question AnsweringHotpotQA full wiki (dev)
F175.1
20
Supporting Fact PredictionHotpotQA full wiki (dev)
F1 Score79.4
19
Showing 10 of 20 rows

Other info

Code

Follow for update