Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

L2-ARCTIC

Benchmarks

Task NameDataset NameSOTA ResultTrend
Accent NormalizationL2-ARCTIC (test)
NAT63.85
9
Automatic Speech RecognitionL2-ARCTIC (test)
WER7.2
9
Phonetic PerceptionL2-ARCTIC
PFER8
8
Suggestion GenerationL2-Arctic-plus (test)
BLEU-220.4
8
Mispronunciation DetectionL2-Arctic-plus (test)
Precision53.8
8
Automatic Speech RecognitionL2-Arctic Arabic and Vietnamese accents (test)
WER (ARB)20.3
8
Automatic Speech RecognitionL2-Arctic Chinese and Vietnamese accents (test)
WER (CHN)25.3
8
Automatic Speech RecognitionL2-Arctic Arabic and Chinese accents (test)
WER (Arabic)20.3
8
Automatic Speech RecognitionL2-ARCTIC created subset
Error Rate (ZH)11.67
8
Speech Quality AssessmentL2-ARCTIC Indian English speakers
NISQA-MOS4.84
6
Accent NeutralizationL2-ARCTIC Indian English speakers
CNA100
6
Speech RecognitionL2-Arctic
Arabic WER22.92
4
Pronunciation Training Feedback GenerationL2-Arctic-plus Human Evaluation (12 samples)
SR (Suggestion Relevance)3.8
4
Speaker Similarity AnalysisL2-ARCTIC Indian English speakers
SpkSim0.86
3
Feedback GenerationL2-Arctic-plus
Average Score2.328
3
Mispronunciation Detection and Suggestion GenerationL2-Arctic-plus
Win Rate96.55
2
Showing 16 of 16 rows