Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Dataset

About

Mainstream zero-shot TTS production systems like Voicebox and Seed-TTS achieve human parity speech by leveraging Flow-matching and Diffusion models, respectively. Unfortunately, human-level audio synthesis leads to identity misuse and information security issues. Currently, many antispoofing models have been developed against deepfake audio. However, the efficacy of current state-of-the-art anti-spoofing models in countering audio synthesized by diffusion and flowmatching based TTS systems remains unknown. In this paper, we proposed the Diffusion and Flow-matching based Audio Deepfake (DFADD) dataset. The DFADD dataset collected the deepfake audio based on advanced diffusion and flowmatching TTS models. Additionally, we reveal that current anti-spoofing models lack sufficient robustness against highly human-like audio generated by diffusion and flow-matching TTS systems. The proposed DFADD dataset addresses this gap and provides a valuable resource for developing more resilient anti-spoofing models.

Jiawei Du, I-Ming Lin, I-Hsiang Chiu, Xuanjun Chen, Haibin Wu, Wenze Ren, Yu Tsao, Hung-yi Lee, Jyh-Shing Roger Jang• 2024

Related benchmarks

TaskDatasetResultRank
Speech Deepfake DetectionRTCFake Online
P0150.45
12
Speech Deepfake DetectionRTCFake Offline
EER47.86
12
Speech Deepfake DetectionRTCFake (All)
EER47.71
12
Showing 3 of 3 rows

Other info

Follow for update