Out-of-Domain Detection for Low-Resource Text Classification Tasks
About
Out-of-domain (OOD) detection for low-resource text classification is a realistic but understudied task. The goal is to detect the OOD cases with limited in-domain (ID) training data, since we observe that training data is often insufficient in machine learning applications. In this work, we propose an OOD-resistant Prototypical Network to tackle this zero-shot OOD detection and few-shot ID classification task. Evaluation on real-world datasets show that the proposed solution outperforms state-of-the-art methods in zero-shot OOD detection task, while maintaining a competitive performance on ID classification task.
Ming Tan, Yang Yu, Haoyu Wang, Dakuo Wang, Saloni Potdar, Shiyu Chang, Mo Yu• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Intent Detection | SNIPS Type 1 (test) | Accuracy85.7 | 15 | |
| Intent Detection | SNIPS Type 2 (test) | Accuracy86.2 | 15 | |
| Intent Detection | SNIPS Type 3 (test) | Accuracy90.4 | 15 |
Showing 3 of 3 rows