Global-to-local Memory Pointer Networks for Task-Oriented Dialogue
About
End-to-end task-oriented dialogue is challenging since knowledge bases are usually large, dynamic and hard to incorporate into a learning framework. We propose the global-to-local memory pointer (GLMP) networks to address this issue. In our model, a global memory encoder and a local memory decoder are proposed to share external knowledge. The encoder encodes dialogue history, modifies global contextual representation, and generates a global memory pointer. The decoder first generates a sketch response with unfilled slots. Next, it passes the global memory pointer to filter the external knowledge for relevant information, then instantiates the slots via the local memory pointers. We empirically show that our model can improve copy accuracy and mitigate the common out-of-vocabulary problem. As a result, GLMP is able to improve over the previous state-of-the-art models in both simulated bAbI Dialogue dataset and human-human Stanford Multi-domain Dialogue dataset on automatic and human evaluation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Task-oriented Dialogue | Stanford Multi-Domain Dialogue (SMD) (test) | BLEU14.79 | 29 | |
| Task-oriented Dialogue Response Generation | Multi-WOZ 2.1 (test) | BLEU6.9 | 22 | |
| Dialogue Response Generation | bAbI Dialogue Task 3 | Accuracy (Per-response)96.3 | 9 | |
| Dialogue Response Generation | bAbI Dialogue Task 1 OOV | Per-response Accuracy1 | 9 | |
| Dialogue Response Generation | bAbI Dialogue Task 2 OOV | Accuracy (Per-response)100 | 9 | |
| Dialogue Response Generation | bAbI Dialogue Task 3 OOV | Accuracy (Per Response)96.7 | 9 | |
| Dialogue Response Generation | bAbI Dialogue Task 5 OOV | Per-response Accuracy92 | 9 | |
| Dialogue Response Generation | bAbI Dialogue Task 4 | Per-response Accuracy100 | 9 | |
| Dialogue Response Generation | bAbI Dialogue Task 5 | Per-response Accuracy99.2 | 9 | |
| Dialogue Response Generation | bAbI Dialogue Task 4 OOV | Per-response Accuracy100 | 9 |