Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Preserving Fairness Generalization in Deepfake Detection

About

Although effective deepfake detection models have been developed in recent years, recent studies have revealed that these models can result in unfair performance disparities among demographic groups, such as race and gender. This can lead to particular groups facing unfair targeting or exclusion from detection, potentially allowing misclassified deepfakes to manipulate public opinion and undermine trust in the model. The existing method for addressing this problem is providing a fair loss function. It shows good fairness performance for intra-domain evaluation but does not maintain fairness for cross-domain testing. This highlights the significance of fairness generalization in the fight against deepfakes. In this work, we propose the first method to address the fairness generalization problem in deepfake detection by simultaneously considering features, loss, and optimization aspects. Our method employs disentanglement learning to extract demographic and domain-agnostic forgery features, fusing them to encourage fair learning across a flattened loss landscape. Extensive experiments on prominent deepfake datasets demonstrate our method's effectiveness, surpassing state-of-the-art approaches in preserving fairness during cross-domain deepfake detection. The code is available at https://github.com/Purdue-M2/Fairness-Generalization

Li Lin, Xinan He, Yan Ju, Xin Wang, Feng Ding, Shu Hu• 2024

Related benchmarks

TaskDatasetResultRank
Deepfake DetectionDFDC
AUC61.47
230
Deepfake DetectionDFD
AUC0.8482
193
Deepfake DetectionCDF v2
AUC0.7442
97
Deepfake DetectionFaceForensics++ (test)
AUC98.28
65
Deepfake DetectionCeleb-DF
ROC-AUC0.6968
48
Frame-level Deepfake DetectionDFDC
AUC0.617
36
Deepfake DetectionFaceForensics++ c23 (train)
FF c23 Score98.28
31
Deepfake DetectionCross-Domain Evaluation (test)
CDFv1 Score74.42
31
Frame-level Deepfake DetectionCeleb-DF v2
AUROC74.4
31
Deepfake DetectionCeleb-DF
Gender FFPR7.95
22
Showing 10 of 19 rows

Other info

Follow for update