VoxPopuli
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Speech Recognition | VoxPopuli (test) | WER5.39 | 52 | |
| Automatic Speech Recognition | VoxPopuli | WER5.6 | 38 | |
| Watermark Detection | VoxPopuli-100k Scenario T1 | AUC100 | 26 | |
| Automatic Speech Recognition | VoxPopuli (dev) | WER6.02 | 18 | |
| Automatic Speech Recognition | VoxPopuli 1.0 (test) | Avg WER6.2 | 14 | |
| Audio Watermarking Attribution | VoxPopuli | FAR (%)3.71 | 12 | |
| Speech-to-speech translation | VoxPopuli En-Fr (test) | BLEU Score25 | 11 | |
| Speech-to-speech translation | VoxPopuli En-Es (test) | BLEU29.2 | 11 | |
| Speech-to-speech translation | VoxPopuli Fr-En (test) | BLEU Score35.9 | 11 | |
| Speech-to-speech translation | VoxPopuli Es-En (test) | BLEU34.7 | 11 | |
| ASR Rescoring | Voxpopuli (test) | WER9.91 | 11 | |
| Text-to-Speech | VoxPopuli en V1.0 | WER (%)10.1 | 9 | |
| Hallucination detection | VOXPOPULI k=10% (test) | Hallucination Rate (%)1.23 | 8 | |
| Hallucination detection | VOXPOPULI (test) | Hallucination Rate (%)2.03 | 8 | |
| Automatic Speech Recognition | VoxPopuli (VP) | WER8.9 | 8 | |
| Speech Recognition | VoxPopuli En | WER5.4 | 7 | |
| Automatic Speech Recognition | VoxPopuli cleaned AA | Error Rate0.0238 | 6 | |
| Text-to-Speech | VoxPopuli | WER10.3 | 6 | |
| Speech Recognition with Timestamps | VoxPopuli (VOXP) | AAS116.37 | 5 | |
| Audio Understanding | Voxpopuli en v1.0 | Error Rate5.76 | 4 | |
| Automatic Speech Recognition | VoxPopuli En V1 | WER6.2 | 3 | |
| Automatic Speech Recognition | VoxPopuli English Open ASR (test) | WER5.99 | 3 | |
| Speech-to-speech translation retrieval (X to Y) | VoxPopuli | FR to DE Retrieval Performance95.2 | 3 | |
| Speech-to-speech translation retrieval (EN to Y) | VoxPopuli | EN->FR Retrieval Score96.54 | 3 | |
| Speech-to-speech translation retrieval (X to EN) | VoxPopuli | FR-EN Performance96.55 | 3 |
Showing 25 of 30 rows