L2-ARCTIC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mispronunciation Detection | L2-ARCTIC (test) | F1 Score71.77 | 20 | |
| Phoneme Recognition | L2-ARCTIC (test) | Phoneme Error Rate (PER)13.72 | 14 | |
| Mispronunciation Diagnosis | L2-ARCTIC (test) | EDR19.98 | 14 | |
| Accent Normalization | L2-ARCTIC (test) | NAT63.85 | 9 | |
| Automatic Speech Recognition | L2-ARCTIC (test) | WER7.2 | 9 | |
| Speech Recognition | L2-Arctic | Arabic WER15.54 | 9 | |
| Phonetic Perception | L2-ARCTIC | PFER8 | 8 | |
| Suggestion Generation | L2-Arctic-plus (test) | BLEU-220.4 | 8 | |
| Mispronunciation Detection | L2-Arctic-plus (test) | Precision53.8 | 8 | |
| Automatic Speech Recognition | L2-Arctic Arabic and Vietnamese accents (test) | WER (ARB)20.3 | 8 | |
| Automatic Speech Recognition | L2-Arctic Chinese and Vietnamese accents (test) | WER (CHN)25.3 | 8 | |
| Automatic Speech Recognition | L2-Arctic Arabic and Chinese accents (test) | WER (Arabic)20.3 | 8 | |
| Automatic Speech Recognition | L2-ARCTIC created subset | Error Rate (ZH)11.67 | 8 | |
| Speech Quality Assessment | L2-ARCTIC Indian English speakers | NISQA-MOS4.84 | 6 | |
| Accent Neutralization | L2-ARCTIC Indian English speakers | CNA100 | 6 | |
| Automatic Speech Recognition | L2-ARCTIC Unseen-accent (UA) | WER7.41 | 4 | |
| Automatic Speech Recognition | L2-ARCTIC (Unseen-transcript (UT)) | WER9.14 | 4 | |
| Automatic Speech Recognition | L2-ARCTIC Korean English (YKWK) | WER0.123 | 4 | |
| Automatic Speech Recognition | L2-ARCTIC Korean English (YDCK) | WER11.6 | 4 | |
| Automatic Speech Recognition | L2-ARCTIC Korean English (HKK) | WER14.1 | 4 | |
| Automatic Speech Recognition | L2-ARCTIC Indian English (SVBI) | WER11.4 | 4 | |
| Automatic Speech Recognition | L2-ARCTIC Indian English (RRBI) | WER10.5 | 4 | |
| Automatic Speech Recognition | L2-ARCTIC Indian English (TNI) | WER12.2 | 4 | |
| Pronunciation Training Feedback Generation | L2-Arctic-plus Human Evaluation (12 samples) | SR (Suggestion Relevance)3.8 | 4 | |
| Speaker Similarity Analysis | L2-ARCTIC Indian English speakers | SpkSim0.86 | 3 |
Showing 25 of 27 rows