Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Fisher

Benchmarks

Task NameDataset NameSOTA ResultTrend
Speech-to-speech translationFisher Spanish-English (test)
BLEU (Speech Input)90.5
55
Speech-to-speech translationFisher Spanish-English (dev)
BLEU (Speech)88.5
48
Speech-to-speech translationFisher Spanish-English (dev2)
ASR BLEU89.4
36
Speech-to-Speech TranslationFisher Es→En (test)
ASR chrF70.2
10
Speech-to-Speech TranslationFisher Es→En (dev)
ASR chrF69.5
10
Speaker-Attributed Automatic Speech RecognitionFisher (test)
WDER0.9
4
ES-to-EN ASTFisher (test)
BLEU64.7
4
Speaker-Attributed Automatic Speech RecognitionFisher Global Meeting-level
DER15.21
4
Speaker-Attributed Automatic Speech RecognitionFisher (local setting)
DER8.18
4
Fine-grained Score AccuracyFisher
Exact Accuracy64.76
1
Binary classification (Human vs Machine speech)Fisher (Human-Human) OOD (test)
Accuracy98.44
1
Showing 11 of 11 rows