ASVspoof 5: Evaluation of Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speech
About
ASVspoof 5 is the fifth edition in a series of challenges which promote the study of speech spoofing and deepfake detection solutions. A significant change from previous challenge editions is a new crowdsourced database collected from a substantially greater number of speakers under diverse recording conditions, and a mix of cutting-edge and legacy generative speech technology. With the new database described elsewhere, we provide in this paper an overview of the ASVspoof 5 challenge results for the submissions of 53 participating teams. While many solutions perform well, performance degrades under adversarial attacks and the application of neural encoding/compression schemes. Together with a review of post-challenge results, we also report a study of calibration in addition to other principal challenges and outline a road-map for the future of ASVspoof.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Spoofing Attack Detection | ASVspoof LA 2021 | EER13.13 | 37 | |
| Spoofing Attack Detection | ASVspoof DF 2021 | EER10.63 | 31 | |
| Anti-spoofing | ITW | EER6.85 | 21 | |
| Spoofing Detection | ASVspoof 5 (eval) | EER3.3 | 18 | |
| Audio anti-spoofing | ASVspoof 5 (evaluation) | EER3.3 | 17 | |
| Audio Spoof Detection | ASVspoof LA 2019 | A0716.27 | 11 | |
| Audio anti-spoofing | in the wild | EER6.85 | 7 | |
| Audio Spoofing Detection | ASVspoof LA 2021 | EER13.13 | 5 | |
| Audio Spoofing Detection | ASVspoof DF 2021 | EER10.63 | 5 |