VoxPopuli
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Speech Recognition | VoxPopuli (test) | WER5.39 | 52 | |
| Automatic Speech Recognition | VoxPopuli | WER5.55 | 44 | |
| Watermark Detection | VoxPopuli-100k Scenario T1 | AUC100 | 34 | |
| Automatic Speech Recognition | VoxPopuli (dev) | WER6.02 | 18 | |
| Automatic Speech Recognition | VoxPopuli 1.0 (test) | Avg WER6.2 | 14 | |
| Audio Watermarking Attribution | VoxPopuli | FAR (%)3.71 | 12 | |
| Speech-to-speech translation | VoxPopuli En-Fr (test) | BLEU Score25 | 11 | |
| Speech-to-speech translation | VoxPopuli En-Es (test) | BLEU29.2 | 11 | |
| Speech-to-speech translation | VoxPopuli Fr-En (test) | BLEU Score35.9 | 11 | |
| Speech-to-speech translation | VoxPopuli Es-En (test) | BLEU34.7 | 11 | |
| ASR Rescoring | Voxpopuli (test) | WER9.91 | 11 | |
| Automatic Speech Recognition | VoxPopuli English | WER5.88 | 10 | |
| Automatic Speech Recognition | VoxPopuli European | WER9.82 | 9 | |
| Text-to-Speech | VoxPopuli en V1.0 | WER (%)10.1 | 9 | |
| Hallucination detection | VOXPOPULI k=10% (test) | Hallucination Rate (%)1.23 | 8 | |
| Hallucination detection | VOXPOPULI (test) | Hallucination Rate (%)2.03 | 8 | |
| Automatic Speech Recognition | VoxPopuli (VP) | WER8.9 | 8 | |
| Speech Recognition | VoxPopuli En | WER5.4 | 7 | |
| Automatic Speech Recognition | VoxPopuli cleaned AA | Error Rate0.0238 | 6 | |
| Text-to-Speech | VoxPopuli | WER10.3 | 6 | |
| Automatic Speech Recognition | VoxPopuli en (test) | WER (%)8.995 | 5 | |
| Streaming Speech-to-Speech Translation | VoxPopuli Short-form FR-EN | Speech Rate (SR)0.06 | 5 | |
| Speech Recognition with Timestamps | VoxPopuli (VOXP) | AAS116.37 | 5 | |
| Audio Understanding | Voxpopuli en v1.0 | Error Rate5.76 | 4 | |
| Automatic Speech Recognition | VoxPopuli En V1 | WER6.2 | 3 |
Showing 25 of 36 rows