Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification

About

Machine reading comprehension (MRC) on real web data usually requires the machine to answer a question by analyzing multiple passages retrieved by search engine. Compared with MRC on a single passage, multi-passage MRC is more challenging, since we are likely to get multiple confusing answer candidates from different passages. To address this problem, we propose an end-to-end neural model that enables those answer candidates from different passages to verify each other based on their content representations. Specifically, we jointly train three modules that can predict the final answer based on three factors: the answer boundary, the answer content and the cross-passage answer verification. The experimental results show that our method outperforms the baseline by a large margin and achieves the state-of-the-art performance on the English MS-MARCO dataset and the Chinese DuReader dataset, both of which are designed for MRC in real-world settings.

Yizhong Wang, Kai Liu, Jing Liu, Wei He, Yajuan Lyu, Hua Wu, Sujian Li, Haifeng Wang• 2018

Related benchmarks

TaskDatasetResultRank
Generative Question AnsweringMsMARCO (test)
ROUGE Score0.484
18
Machine Reading ComprehensionMS-MARCO (test)
ROUGE-L46.66
9
Machine Reading ComprehensionDuReader 1.0 (test)
BLEU-440.97
6
Machine Reading ComprehensionDuReader (test)
BLEU-440.97
5
Machine Reading ComprehensionMS MARCO (dev)
ROUGE45.65
4
Showing 5 of 5 rows

Other info

Follow for update