CVSS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Speech-to-speech translation | CVSS-C | Avg Score0.911 | 38 | |
| Speech-to-speech translation | CVSS-C DE → EN (test) | ASR-BLEU75.53 | 16 | |
| Speech-to-speech translation | CVSS-C ES → EN (test) | ASR-BLEU88.54 | 16 | |
| Speech-to-Speech Translation | CVSS-C Fr→En | ASR-BLEU84.52 | 11 | |
| Offline Speech-to-Speech Translation | CVSS-C (test) | Fr-En ASR-BLEU84.52 | 11 | |
| Speech-to-Speech Translation | CVSS-C Average | ASR-BLEU82.86 | 10 | |
| Speech-to-Speech Translation | CVSS-C Es→En | ASR-BLEU88.54 | 10 | |
| Speech-to-Speech Translation | CVSS-C De→En | ASR BLEU75.53 | 10 | |
| Speech-to-Speech Translation | CVSS-T zh→en | ASR-BLEU23.6 | 10 | |
| Speech-to-Speech Translation | CVSS-T en→zh | ASR-BLEU32.5 | 10 | |
| Speech Naturalness Assessment | CVSS-T | UTMOS3.67 | 10 | |
| Speech-to-Speech Translation (fra2en) | CVSS-T | BLEU Score22.91 | 10 | |
| Speech-to-Speech Translation (en2fra) | CVSS-T | BLEU Score25.37 | 10 | |
| Speech Naturalness Assessment | CVSS-C | UTMOS Score3.74 | 10 | |
| Speech-to-Speech Translation (fra2en) | CVSS-C | BLEU0.2282 | 10 | |
| Speech-to-Speech Translation | CVSS (test) | ASR-BLEU (Fr->En)84.52 | 9 | |
| Speech-to-speech translation | CVSS En-Fr (test) | ASR BLEU17.54 | 8 | |
| Speech-to-speech translation | CVSS En-Es (test) | ASR-BLEU19.49 | 8 | |
| Speech-to-Speech Translation | CVSS-C | Fr->En BLASER 2.0 Score4.21 | 7 | |
| Speech-to-Text Translation (fra2en) | CVSS-T | BLEU Score24.54 | 7 | |
| Speech-to-Text Translation (en2fra) | CVSS-T | BLEU26.83 | 7 | |
| Speech-to-Text Translation (fra2en) | CVSS-C | BLEU24.4 | 7 | |
| Speech-to-Text Translation (en2fra) | CVSS-C | BLEU29.97 | 7 | |
| Speech-to-speech translation | CVSS Es-En | BLEU86.48 | 7 | |
| Speech-to-speech translation | CVSS Fr-En | BLEU84.36 | 7 |
Showing 25 of 48 rows