Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational Machine Reading Comprehension
About
Open-retrieval conversational machine reading comprehension (OCMRC) simulates real-life conversational interaction scenes. Machines are required to make a decision of "Yes/No/Inquire" or generate a follow-up question when the decision is "Inquire" based on retrieved rule texts, user scenario, user question, and dialogue history. Recent studies explored the methods to reduce the information gap between decision-making and question generation and thus improve the performance of generation. However, the information gap still exists because these pipeline structures are still limited in decision-making, span extraction, and question rephrasing three stages. Decision-making and generation are reasoning separately, and the entailment reasoning utilized in decision-making is hard to share through all stages. To tackle the above problem, we proposed a novel one-stage end-to-end framework, called Entailment Fused-T5 (EFT), to bridge the information gap between decision-making and generation in a global understanding manner. The extensive experimental results demonstrate that our proposed framework achieves new state-of-the-art performance on the OR-ShARC benchmark.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Decision Making | OR-ShARC (dev) | Micro Avg83.4 | 7 | |
| Decision Making | OR-ShARC (test) | Micro Aggregation Score0.785 | 7 | |
| Question Generation | OR-ShARC (dev) | F1 (BLEU-1)65.5 | 7 | |
| Question Generation | OR-ShARC (test) | F1 (BLEU-1)59.3 | 7 | |
| Open-retrieval | OR-ShARC (dev) | Top-1 Accuracy54.5 | 4 | |
| Open-retrieval | OR-ShARC (test) | Top-1 Accuracy77.5 | 4 | |
| Question Generation | OR-ShARC (test seen) | F1-BLEU-183.4 | 3 | |
| Question Generation | OR-ShARC unseen (test) | F1 BLEU-134.9 | 3 |