Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multilingual

Benchmarks

Task NameDataset NameSOTA ResultTrend
Speech EnhancementMultilingual low-SNR (evaluation set)
PESQ3.2
23
Multilingual Language ModelingMultilingual MMMLU MGSM
MMMLU Score55.67
12
GlossingMultilingual held-out (test)
Morpheme Error Rate (arp)0.152
5
Machine TranslationMultilingual Translation
Score31.9
5
Mathematical ReasoningMultilingual Mathematics
Score57.5
5
Language UnderstandingMultilingual Understanding
Score72
5
Language UnderstandingMultilingual Exam
Score59.2
5
Text-to-SpeechMultilingual Avg (test)
WER6.39
3
Text-to-SpeechMultilingual zh (test)
WER3
3
Text-to-SpeechMultilingual vi (test)
SIM0.541
3
Text-to-SpeechMultilingual ru (test)
WER11.84
3
Text-to-SpeechMultilingual pt (test)
WER2.09
3
Text-to-SpeechMultilingual it (test)
WER4.43
3
Text-to-SpeechMultilingual id (test)
WER6.38
3
Text-to-SpeechMultilingual fr (test)
WER9.87
3
Text-to-SpeechMultilingual es (test)
WER4.28
3
Text-to-SpeechMultilingual en (test)
WER1.07
3
Text-to-SpeechMultilingual de (test)
WER0.44
3
Showing 18 of 18 rows