Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Smoothing Dialogue States for Open Conversational Machine Reading

About

Conversational machine reading (CMR) requires machines to communicate with humans through multi-turn interactions between two salient dialogue states of decision making and question generation processes. In open CMR settings, as the more realistic scenario, the retrieved background knowledge would be noisy, which results in severe challenges in the information transmission. Existing studies commonly train independent or pipeline systems for the two subtasks. However, those methods are trivial by using hard-label decisions to activate question generation, which eventually hinders the model performance. In this work, we propose an effective gating strategy by smoothing the two dialogue states in only one decoder and bridge decision making and question generation to provide a richer dialogue state reference. Experiments on the OR-ShARC dataset show the effectiveness of our method, which achieves new state-of-the-art results.

Zhuosheng Zhang, Siru Ouyang, Hai Zhao, Masao Utiyama, Eiichiro Sumita• 2021

Related benchmarks

TaskDatasetResultRank
Decision MakingOR-ShARC (dev)
Micro Avg80.5
7
Decision MakingOR-ShARC (test)
Micro Aggregation Score0.765
7
Question GenerationOR-ShARC (dev)
F1 (BLEU-1)51.3
7
Question GenerationOR-ShARC (test)
F1 (BLEU-1)49.1
7
Question GenerationOR-ShARC unseen (test)
F1 BLEU-134.9
3
Question GenerationOR-ShARC (test seen)
F1-BLEU-164.6
3
Showing 6 of 6 rows

Other info

Follow for update