Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FLEURS

Benchmarks

Task NameDataset NameSOTA ResultTrend
Automatic Speech RecognitionFleurs
WER0.1058
56
Script confusion mitigationFLEURS zh-trad (test)
Accuracy91
21
Script confusion mitigationFLEURS zh-sim (test)
Normalized Edit Similarity Accuracy93
21
Script confusion mitigationFLEURS sr-cyrl (test)
Normalized Edit Similarity0.94
21
Script confusion mitigationFLEURS sr-latn (test)
Accuracy (Normalized Edit Similarity)96
21
Speech RecognitionFleurs En
WER2.4
20
Automatic Speech RecognitionFleurs en (test)
WER0.336
17
Speech TranslationFLEURS (test)
COMET (Low)0.853
15
Document RetrievalFleurs Retrieval-Eval (test)
nDCG@557.89
13
Speech TranslationFLEURS X→En (test)
BLEU (Average)34
12
Automatic Speech RecognitionFleurs zh
WER0.83
11
Speech-to-Text TranslationFLEURS 9×27 directions (test)
ara78.7
10
Automatic Speech RecognitionFLEURS Seen-Weak
WER25.19
8
Automatic Speech RecognitionFLEURS Unseen Languages
WER0.4646
8
Language IdentificationFLEURS SSA 102 (test)
Accuracy93.7
8
Speech-to-Text TranslationFLEURS 9×69 directions (test)
ARA Score79
8
Automatic Speech Recognitionfleurs Telugu
CER10.3
8
Automatic Speech Recognitionfleurs Tamil
CER11.8
8
Automatic Speech Recognitionfleurs Marathi
CER9.4
8
Automatic Speech Recognitionfleurs Hindi
CER8.2
8
Audio-visual speech-to-text translationFLEURS (test)
Average BLEU16
8
Speech ResynthesisFLEURS-R Spanish (test)
WER2.91
7
Cross-modal and cross-lingual retrievalFLEURS (test)
Avg xSIM++ (26)15.7
7
Automatic Speech RecognitionFleurs
CER (eng)9.1
6
Automatic Speech RecognitionFleurs
En WER3.38
6
Showing 25 of 53 rows