Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System

About

Dialogue data in real scenarios tend to be sparsely available, rendering data-starved end-to-end dialogue systems trained inadequately. We discover that data utilization efficiency in low-resource scenarios can be enhanced by mining alignment information uncertain utterance and deterministic dialogue state. Therefore, we innovatively implement dual learning in task-oriented dialogues to exploit the correlation of heterogeneous data. In addition, the one-to-one duality is converted into a multijugate duality to reduce the influence of spurious correlations in dual training for generalization. Without introducing additional parameters, our method could be implemented in arbitrary networks. Extensive empirical analyses demonstrate that our proposed method improves the effectiveness of end-to-end task-oriented dialogue systems under multiple benchmarks and obtains state-of-the-art results in low-resource scenarios.

Shimin Li, Xiaotian Zhang, Yanjun Zheng, Linyang Li, Xipeng Qiu• 2023

Related benchmarks

TaskDatasetResultRank
Dialogue State TrackingMultiWOZ 2.1 (test)
Joint Goal Accuracy53.85
85
End-to-end task-oriented dialogueMultiWOZ 2.1 (test)
BLEU Score19.03
49
Dialog State TrackingMultiWOZ 2.0 (test)
Joint Goal Accuracy54.41
47
End-to-end task-oriented dialogueMultiWOZ 2.0 (test)
Inform Accuracy92.7
22
Task-oriented DialogueMultiWOZ 5% 2.0 (train)
Inform85.65
10
Task-oriented DialogueMultiWOZ 2.0 (10% train)
Inform Rate86.3
10
Task-oriented DialogueMultiWOZ 20% 2.0 (train)
Inform90.25
10
Dialogue State TrackingMultiWOZ 5% 2.0 (train)
Joint Goal Acc40.9
5
Dialogue State TrackingMultiWOZ 10% 2.0 (train)
Joint Goal Acc45.1
5
Dialogue State TrackingMultiWOZ 20% 2.0 (train)
Joint Goal Accuracy47.89
5
Showing 10 of 11 rows

Other info

Follow for update