Intent Detection

Benchmarks

Dataset Name	SOTA Method	Metric
ATIS		ID Accuracy99.43	27	2d ago
M2M	MIDAS	Accuracy94.27	18	4d ago
MWOZ	MIDAS	Accuracy85.02	18	4d ago
SLURP	ML-LMCL	Accuracy89.16	16	4d ago
CLINC 10-shot (test)	ROBERTa-Large + Classifier + ICDA	Accuracy94.84	16	4d ago
HWU 10-shot (test)	ROBERTa-Large + Classifier + ICDA	Accuracy87.41	16	4d ago
BANKING 10-shot (test)	ROBERTa-Large + Classifier + ICDA	Accuracy89.79	16	4d ago
ATIS (test)	Joint model with recurrent intent + slot label context	Intent Error1.57	13	4d ago
CLINC 5-shot (test)	ROBERTa-Large + Classifier + ICDA	Accuracy92.62	12	4d ago
HWU 5-shot (test)	ROBERTa-Large + Classifier + ICDA	Accuracy0.8245	12	4d ago
BANKING 5-shot (test)	ROBERTa-Large + Classifier + ICDA	Accuracy84.01	12	4d ago
CLINC Full (test)	CONVBERT	Accuracy97.31	11	4d ago
HWU Full (test)	CONVBERT	Accuracy93.03	11	4d ago
BANKING Full (test)	ROBERTa-Large + Classifier + ICDA	Accuracy94.42	11	4d ago
TREC6	ML-LMCL	Accuracy89.96	10	4d ago
SNIPS	TANL	F1 Score98.7	8	2d ago
ATIS	E et al., 2019	F1 Score97.8	8	2d ago
MultiATIS++ (test)	GL-CLEF	Acc (en)98.77	5	4d ago
Intent Coded Original Posts (Smoking Cessation Support Groups) All Intent Labels (Average)	two-level data augmentation strategy	Precision86.1	4	4d ago
ATIS noisy speech input (test)	2-gram LM decoding + Joint training RNN LM rescoring	Intent Error Rate4.44	4	4d ago
Additional ATIS corpus (10-fold cross val)	Attention BiRNN	Intent Error5.6	4	4d ago
SNIPS (test)	TAPIR-LT	Throughput (sentences/sec)8.983	3	3d ago
CAIS	CM-Net	Accuracy94.56	3	4d ago

Showing 23 of 23 rows