Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection

About

Recent studies in deepfake detection have yielded promising results when the training and testing face forgeries are from the same dataset. However, the problem remains challenging when one tries to generalize the detector to forgeries created by unseen methods in the training dataset. This work addresses the generalizable deepfake detection from a simple principle: a generalizable representation should be sensitive to diverse types of forgeries. Following this principle, we propose to enrich the "diversity" of forgeries by synthesizing augmented forgeries with a pool of forgery configurations and strengthen the "sensitivity" to the forgeries by enforcing the model to predict the forgery configurations. To effectively explore the large forgery augmentation space, we further propose to use the adversarial training strategy to dynamically synthesize the most challenging forgeries to the current model. Through extensive experiments, we show that the proposed strategies are surprisingly effective (see Figure 1), and they could achieve superior performance than the current state-of-the-art methods. Code is available at \url{https://github.com/liangchen527/SLADD}.

Liang Chen, Yong Zhang, Yibing Song, Lingqiao Liu, Jue Wang• 2022

Related benchmarks

TaskDatasetResultRank
Deepfake DetectionDFDC
AUC78.7
150
Deepfake DetectionDFDC (test)
AUC77.2
122
Deepfake DetectionDFD
AUC0.772
91
Deepfake DetectionCDFv1, CDFv2, DFD, DFDCP, DFDC (test)
Overall Average Score76.42
74
Deepfake DetectionDFDCP (test)--
55
Deepfake DetectionCelebDF (CDF) v2 (test)
AUC79.7
52
Deepfake DetectionCeleb-DF v2 (test)
Video-level AUC0.837
48
Face Forgery DetectionCeleb-DF
AUC80
46
Deepfake DetectionFF++ (test)
AUC98.4
44
Deepfake DetectionDeepfakeDetection (DFD) (test)
AUC90.4
43
Showing 10 of 26 rows

Other info

Code

Follow for update