Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Out-of-Domain Detection for Low-Resource Text Classification Tasks

About

Out-of-domain (OOD) detection for low-resource text classification is a realistic but understudied task. The goal is to detect the OOD cases with limited in-domain (ID) training data, since we observe that training data is often insufficient in machine learning applications. In this work, we propose an OOD-resistant Prototypical Network to tackle this zero-shot OOD detection and few-shot ID classification task. Evaluation on real-world datasets show that the proposed solution outperforms state-of-the-art methods in zero-shot OOD detection task, while maintaining a competitive performance on ID classification task.

Ming Tan, Yang Yu, Haoyu Wang, Dakuo Wang, Saloni Potdar, Shiyu Chang, Mo Yu• 2019

Related benchmarks

TaskDatasetResultRank
Intent DetectionSNIPS Type 1 (test)
Accuracy85.7
15
Intent DetectionSNIPS Type 2 (test)
Accuracy86.2
15
Intent DetectionSNIPS Type 3 (test)
Accuracy90.4
15
Showing 3 of 3 rows

Other info

Follow for update