Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TripPy: A Triple Copy Strategy for Value Independent Neural Dialog State Tracking

About

Task-oriented dialog systems rely on dialog state tracking (DST) to monitor the user's goal during the course of an interaction. Multi-domain and open-vocabulary settings complicate the task considerably and demand scalable solutions. In this paper we present a new approach to DST which makes use of various copy mechanisms to fill slots with values. Our model has no need to maintain a list of candidate values. Instead, all values are extracted from the dialog context on-the-fly. A slot is filled by one of three copy mechanisms: (1) Span prediction may extract values directly from the user input; (2) a value may be copied from a system inform memory that keeps track of the system's inform operations; (3) a value may be copied over from a different slot that is already contained in the dialog state to resolve coreferences within and across domains. Our approach combines the advantages of span-based slot filling methods with memory methods to avoid the use of value picklists altogether. We argue that our strategy simplifies the DST task while at the same time achieving state of the art performance on various popular evaluation sets including Multiwoz 2.1, where we achieve a joint goal accuracy beyond 55%.

Michael Heck, Carel van Niekerk, Nurul Lubis, Christian Geishauser, Hsien-Chin Lin, Marco Moresi, Milica Ga\v{s}i\'c• 2020

Related benchmarks

TaskDatasetResultRank
Dialogue State TrackingMultiWOZ 2.1 (test)
Joint Goal Accuracy55.3
105
Dialog State TrackingMultiWOZ 2.1 (test)
Joint Goal Accuracy61.31
88
Dialogue State TrackingMultiWOZ 2.2 (test)
Joint Goal Accuracy53.5
80
Dialogue State TrackingMultiWOZ 2.4 (test)
Joint Goal Acc64.75
45
Dialogue State TrackingMultiWOZ 2.1
Joint Goal Accuracy55.3
36
Dialogue State TrackingMultiWOZ 2.3 (test)
JGA63
11
Dialogue State TrackingMultiWOZ 2.3
Joint Goal Accuracy63
9
Dialogue State TrackingMultiWOZ 2.2
Joint GA53.5
9
Dialogue State TrackingMultiWOZ 2.4
Joint Goal Accuracy59.6
8
Dialogue State TrackingSim-M (test)
Joint Goal Accuracy83.5
7
Showing 10 of 13 rows

Other info

Follow for update