ASR Error Correction

Benchmarks

Dataset Name	SOTA Method	Metric
STOP (test)		WER5.7	18	1mo ago
CommonVoice (CV) (test)		WER5.8	18	1mo ago
CORAAL (test)		WER10.7	8	1mo ago
LRS2 (test)		WER2.6	8	1mo ago
SwitchBoard (test)		Word Error Rate (WER)0.042	8	1mo ago
CV-accent (test)		WER0.079	8	1mo ago
Tedlium-3 (test)		WER0.7	8	1mo ago
CHIME-4 (test)		WER2.8	8	1mo ago
ATIS (test)		WER1.1	8	1mo ago
ASR Error Correction Evaluation Set (test)	Our full model	WER16.07	6	1mo ago
Internal Dataset (dev)	AR model	WER10.31	6	1mo ago
Internal Dataset (test)	AR model	WER10.22	6	1mo ago
AISHELL-1 (dev)	AR model	WER3.8	6	1mo ago
AISHELL-1 (test)	AR model	WER4.08	6	1mo ago
Common Voice (Persian) SNR = 10 dB	ELN-conditioned model	WER28.02	4	1mo ago
Common Voice (Persian) SNR = 5 dB	ELN-conditioned model	WER32.34	4	1mo ago
Common Voice (Persian) Mixed Noise	ELN-conditioned model	WER24.84	4	1mo ago
Common Voice Persian (Clean)		WER24.06	4	1mo ago
MedMCQA (test)	MedSpeak	WER28.1	3	1mo ago
MedQA (test)	MedSpeak	WER43.5	3	1mo ago
MMLU (test)		Clinical Accuracy76.7	3	1mo ago
ChFT extra-long (test)	CoC	Mandarin Error Rate4.19	2	1mo ago
VB-DEMAND English (test)	ELN-conditioned model	Baseline WER7.93	2	1mo ago

Showing 23 of 23 rows