Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Robust Zero-Shot Cross-Domain Slot Filling with Example Values

About

Task-oriented dialog systems increasingly rely on deep learning-based slot filling models, usually needing extensive labeled training data for target domains. Often, however, little to no target domain training data may be available, or the training and target domain schemas may be misaligned, as is common for web forms on similar websites. Prior zero-shot slot filling models use slot descriptions to learn concepts, but are not robust to misaligned schemas. We propose utilizing both the slot description and a small number of examples of slot values, which may be easily available, to learn semantic representations of slots which are transferable across domains and robust to misaligned schemas. Our approach outperforms state-of-the-art models on two multi-domain datasets, especially in the low-data setting.

Darsh J Shah, Raghav Gupta, Amir A Fayazi, Dilek Hakkani-Tur• 2019

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionSciTech News Target Domain
F1 Score68.12
19
Slot FillingSNIPS PlayMusic zero-shot (test)
F1 Score33.12
11
Slot FillingSNIPS zero-shot AddToPlaylist
F1 Score42.77
11
Slot FillingSNIPS BookRestaurant zero-shot
F1 Score30.68
11
Slot FillingSNIPS GetWeather zero-shot
F1 Score50.28
11
Slot FillingSNIPS zero-shot Average
F1 Score32.85
11
Slot FillingSNIPS RateBook zero-shot (test)
F1 Score16.43
11
Slot FillingSNIPS SearchCreativeWork zero-shot (test)
F1-score44.45
11
Slot FillingSNIPS zero-shot (SearchScreeningEvent)
F1 Score12.25
11
Showing 9 of 9 rows

Other info

Follow for update