Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational Machine Reading Comprehension

About

Open-retrieval conversational machine reading comprehension (OCMRC) simulates real-life conversational interaction scenes. Machines are required to make a decision of "Yes/No/Inquire" or generate a follow-up question when the decision is "Inquire" based on retrieved rule texts, user scenario, user question, and dialogue history. Recent studies explored the methods to reduce the information gap between decision-making and question generation and thus improve the performance of generation. However, the information gap still exists because these pipeline structures are still limited in decision-making, span extraction, and question rephrasing three stages. Decision-making and generation are reasoning separately, and the entailment reasoning utilized in decision-making is hard to share through all stages. To tackle the above problem, we proposed a novel one-stage end-to-end framework, called Entailment Fused-T5 (EFT), to bridge the information gap between decision-making and generation in a global understanding manner. The extensive experimental results demonstrate that our proposed framework achieves new state-of-the-art performance on the OR-ShARC benchmark.

Xiao Zhang, Heyan Huang, Zewen Chi, Xian-Ling Mao• 2022

Related benchmarks

TaskDatasetResultRank
Decision MakingOR-ShARC (dev)
Micro Avg83.4
7
Decision MakingOR-ShARC (test)
Micro Aggregation Score0.785
7
Question GenerationOR-ShARC (dev)
F1 (BLEU-1)65.5
7
Question GenerationOR-ShARC (test)
F1 (BLEU-1)59.3
7
Open-retrievalOR-ShARC (dev)
Top-1 Accuracy54.5
4
Open-retrievalOR-ShARC (test)
Top-1 Accuracy77.5
4
Question GenerationOR-ShARC (test seen)
F1-BLEU-183.4
3
Question GenerationOR-ShARC unseen (test)
F1 BLEU-134.9
3
Showing 8 of 8 rows

Other info

Follow for update