Spoken Language Understanding

Benchmarks

Dataset Name	SOTA Method	Metric
ATIS (test)	Bi-model	Slot F196.89	18	3mo ago
FSC (test)	Cascaded	Intent Accuracy100	16	3mo ago
ATIS	Cascaded	Slot F196.1	16	3mo ago
SNIPS	Joint BERT	Slot F197	15	3mo ago
MEDIA	FlauBERT-B	SLU CER10.2	14	3mo ago
Fluent Speech Commands (test)	3D-CNN+LSTM+CE	Accuracy99.26	12	3mo ago
BBA	Qwen3-Omni-30B-A3B-Thinking	LBBA Score96.8	11	21d ago
MixSNIPS	SSRAN	Intent Accuracy98.4	10	3mo ago
SLURP 6 tasks		Avg Accuracy84.41	9	3mo ago
SLURP 3 tasks		Average Accuracy84.41	9	3mo ago
FSC 3 tasks		Avg Accuracy99.28	9	3mo ago
CrossWOZ	MLM + SBO + PMO w/ NP Sampling	Intent F196.97	7	3mo ago
in-house SLU dataset	FANS-c	RI-ICER0	6	3mo ago
SILICONE 1.0 (test)	HT	Avg Score74.3	6	3mo ago
SLURP (test)	MATE	Scenario Accuracy78.76	5	3mo ago
MultiATIS++ (test)	GL-CLEF	Accuracy (EN)88.02	5	3mo ago
Internal Traffic Dataset hard (test)	transformer-based E2E SLU	ICER (Relative Improvement)12.9	5	3mo ago
Internal Traffic Dataset (regular test)	transformer-based E2E SLU	ICER Improvement (%)9.3	5	3mo ago
Spoken StoryCloze (TSTORYCLOZE)		Accuracy90.2	4	3mo ago
Spoken StoryCloze (SSTORYCLOZE)		Accuracy79.9	4	3mo ago
FluentSpeech (test)		HypER8.3	4	3mo ago
SNIPS Far Field	AT-AT	EM Accuracy (Hyp)74.64	4	3mo ago
SNIPS Close Field	AT-AT	EM Accuracy (Hyp)84.88	4	3mo ago
Internal Music dataset Full (test)	AT-AT	SemER-1.16	4	3mo ago
Facebook TOP recorded speech (test)	AT-AT	EM Accuracy70.6	3	3mo ago

Showing 25 of 29 rows