Spoken Language Understanding

Benchmarks

Dataset Name	SOTA Method	Metric
ATIS (test)	Bi-model	Slot F196.89	18	1mo ago
FSC (test)	Cascaded	Intent Accuracy100	16	1mo ago
ATIS	Cascaded	Slot F196.1	16	1mo ago
SNIPS	Joint BERT	Slot F197	15	1mo ago
MEDIA	FlauBERT-B	SLU CER10.2	14	1mo ago
Fluent Speech Commands (test)	3D-CNN+LSTM+CE	Accuracy99.26	12	1mo ago
MixSNIPS	SSRAN	Intent Accuracy98.4	10	1mo ago
SLURP 6 tasks		Avg Accuracy84.41	9	1mo ago
SLURP 3 tasks		Average Accuracy84.41	9	1mo ago
FSC 3 tasks		Avg Accuracy99.28	9	1mo ago
CrossWOZ	MLM + SBO + PMO w/ NP Sampling	Intent F196.97	7	1mo ago
in-house SLU dataset	FANS-c	RI-ICER0	6	1mo ago
SILICONE 1.0 (test)	HT	Avg Score74.3	6	1mo ago
SLURP (test)	MATE	Scenario Accuracy78.76	5	1mo ago
MultiATIS++ (test)	GL-CLEF	Accuracy (EN)88.02	5	1mo ago
Internal Traffic Dataset hard (test)	transformer-based E2E SLU	ICER (Relative Improvement)12.9	5	1mo ago
Internal Traffic Dataset (regular test)	transformer-based E2E SLU	ICER Improvement (%)9.3	5	1mo ago
Spoken StoryCloze (TSTORYCLOZE)		Accuracy90.2	4	1mo ago
Spoken StoryCloze (SSTORYCLOZE)		Accuracy79.9	4	1mo ago
FluentSpeech (test)		HypER8.3	4	1mo ago
SNIPS Far Field	AT-AT	EM Accuracy (Hyp)74.64	4	1mo ago
SNIPS Close Field	AT-AT	EM Accuracy (Hyp)84.88	4	1mo ago
Internal Music dataset Full (test)	AT-AT	SemER-1.16	4	1mo ago
Facebook TOP recorded speech (test)	AT-AT	EM Accuracy70.6	3	1mo ago
internal books dataset (test)	AT-AT	SemER3.31	3	1mo ago

Showing 25 of 28 rows