Robust Zero-Shot Cross-Domain Slot Filling with Example Values
About
Task-oriented dialog systems increasingly rely on deep learning-based slot filling models, usually needing extensive labeled training data for target domains. Often, however, little to no target domain training data may be available, or the training and target domain schemas may be misaligned, as is common for web forms on similar websites. Prior zero-shot slot filling models use slot descriptions to learn concepts, but are not robust to misaligned schemas. We propose utilizing both the slot description and a small number of examples of slot values, which may be easily available, to learn semantic representations of slots which are transferable across domains and robust to misaligned schemas. Our approach outperforms state-of-the-art models on two multi-domain datasets, especially in the low-data setting.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Named Entity Recognition | SciTech News Target Domain | F1 Score68.12 | 19 | |
| Slot Filling | SNIPS PlayMusic zero-shot (test) | F1 Score33.12 | 11 | |
| Slot Filling | SNIPS zero-shot AddToPlaylist | F1 Score42.77 | 11 | |
| Slot Filling | SNIPS BookRestaurant zero-shot | F1 Score30.68 | 11 | |
| Slot Filling | SNIPS GetWeather zero-shot | F1 Score50.28 | 11 | |
| Slot Filling | SNIPS zero-shot Average | F1 Score32.85 | 11 | |
| Slot Filling | SNIPS RateBook zero-shot (test) | F1 Score16.43 | 11 | |
| Slot Filling | SNIPS SearchCreativeWork zero-shot (test) | F1-score44.45 | 11 | |
| Slot Filling | SNIPS zero-shot (SearchScreeningEvent) | F1 Score12.25 | 11 |