SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Filling
About
Utterance-level intent detection and token-level slot filling are two key tasks for natural language understanding (NLU) in task-oriented systems. Most existing approaches assume that only a single intent exists in an utterance. However, there are often multiple intents within an utterance in real-life scenarios. In this paper, we propose a multi-intent NLU framework, called SLIM, to jointly learn multi-intent detection and slot filling based on BERT. To fully exploit the existing annotation data and capture the interactions between slots and intents, SLIM introduces an explicit slot-intent classifier to learn the many-to-one mapping between slots and intents. Empirical results on three public multi-intent datasets demonstrate (1) the superior performance of SLIM compared to the current state-of-the-art for NLU with multiple intents and (2) the benefits obtained from the slot-intent classifier.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Joint Multiple Intent Detection and Slot Filling | MixSNIPS (test) | Slot F196.5 | 57 | |
| Joint Multiple Intent Detection and Slot Filling | MixATIS (test) | F1 Score (Slot)88.5 | 42 | |
| Multi-intent Natural Language Understanding | MixATIS (test) | Overall Accuracy46.4 | 16 | |
| Multi-intent Natural Language Understanding | DSTC4 | Slot F161.1 | 3 |