Spoken Language Understanding

Benchmarks

Dataset Name	SOTA Method	Metric
ATIS (test)	Bi-model	Slot F196.89	18	4d ago
FSC (test)	Cascaded	Intent Accuracy100	16	4d ago
ATIS	Cascaded	Slot F196.1	16	4d ago
SNIPS	Joint BERT	Slot F197	15	4d ago
MEDIA	FlauBERT-B	SLU CER10.2	14	4d ago
Fluent Speech Commands (test)	3D-CNN+LSTM+CE	Accuracy99.26	12	4d ago
MixSNIPS	SSRAN	Intent Accuracy98.4	10	4d ago
SLURP 6 tasks		Avg Accuracy84.41	9	4d ago
SLURP 3 tasks		Average Accuracy84.41	9	4d ago
FSC 3 tasks		Avg Accuracy99.28	9	4d ago
CrossWOZ	MLM + SBO + PMO w/ NP Sampling	Intent F196.97	7	4d ago
in-house SLU dataset	FANS-c	RI-ICER0	6	4d ago
SILICONE 1.0 (test)	HT	Avg Score74.3	6	4d ago
SLURP (test)	MATE	Scenario Accuracy78.76	5	4d ago
MultiATIS++ (test)	GL-CLEF	Accuracy (EN)88.02	5	4d ago
Internal Traffic Dataset hard (test)	transformer-based E2E SLU	ICER (Relative Improvement)12.9	5	4d ago
Internal Traffic Dataset (regular test)	transformer-based E2E SLU	ICER Improvement (%)9.3	5	4d ago
Spoken StoryCloze (TSTORYCLOZE)		Accuracy90.2	4	4d ago
Spoken StoryCloze (SSTORYCLOZE)		Accuracy79.9	4	4d ago
FluentSpeech (test)		HypER8.3	4	4d ago
SNIPS Far Field	AT-AT	EM Accuracy (Hyp)74.64	4	4d ago
SNIPS Close Field	AT-AT	EM Accuracy (Hyp)84.88	4	4d ago
Internal Music dataset Full (test)	AT-AT	SemER-1.16	4	4d ago
Facebook TOP recorded speech (test)	AT-AT	EM Accuracy70.6	3	4d ago
internal books dataset (test)	AT-AT	SemER3.31	3	4d ago

Showing 25 of 28 rows