GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling
About
Multi-intent SLU can handle multiple intents in an utterance, which has attracted increasing attention. However, the state-of-the-art joint models heavily rely on autoregressive approaches, resulting in two issues: slow inference speed and information leakage. In this paper, we explore a non-autoregressive model for joint multiple intent detection and slot filling, achieving more fast and accurate. Specifically, we propose a Global-Locally Graph Interaction Network (GL-GIN) where a local slot-aware graph interaction layer is proposed to model slot dependency for alleviating uncoordinated slots problem while a global intent-slot graph interaction layer is introduced to model the interaction between multiple intents and all slots in the utterance. Experimental results on two public datasets show that our framework achieves state-of-the-art performance while being 11.5 times faster.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Joint Multiple Intent Detection and Slot Filling | MixSNIPS (test) | Slot F194.9 | 57 | |
| Joint Multiple Intent Detection and Slot Filling | MixATIS (test) | F1 Score (Slot)88.3 | 42 | |
| Slot Filling and Intent Detection | MixSNIPS | Overall Accuracy82.6 | 31 | |
| Slot Filling and Intent Detection | MixATIS | Slot F188.3 | 17 | |
| Multi-Intent Spoken Language Understanding | MixATIS | Overall Accuracy53.6 | 16 | |
| Multi-intent Natural Language Understanding | MixATIS (test) | Overall Accuracy43.5 | 16 | |
| Spoken Language Understanding | MixSNIPS | Intent Accuracy95.6 | 10 | |
| Joint Multiple Intent Detection and Slot Filling | MixATIS | Slot F188.3 | 8 | |
| Joint Multiple Intent Detection and Slot Filling | MultiATIS (test) | Slot F10.948 | 4 | |
| Joint Multiple Intent Detection and Slot Filling | MultiSNIPS (test) | Slot F193.6 | 4 |