Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CORE: Consistent Representation Learning for Face Forgery Detection

About

Face manipulation techniques develop rapidly and arouse widespread public concerns. Despite that vanilla convolutional neural networks achieve acceptable performance, they suffer from the overfitting issue. To relieve this issue, there is a trend to introduce some erasing-based augmentations. We find that these methods indeed attempt to implicitly induce more consistent representations for different augmentations via assigning the same label for different augmented images. However, due to the lack of explicit regularization, the consistency between different representations is less satisfactory. Therefore, we constrain the consistency of different representations explicitly and propose a simple yet effective framework, COnsistent REpresentation Learning (CORE). Specifically, we first capture the different representations with different augmentations, then regularize the cosine distance of the representations to enhance the consistency. Extensive experiments (in-dataset and cross-dataset) demonstrate that CORE performs favorably against state-of-the-art face forgery detection methods.

Yunsheng Ni, Depu Meng, Changqian Yu, Chengbin Quan, Dongchun Ren, Youjian Zhao• 2022

Related benchmarks

TaskDatasetResultRank
Deepfake DetectionDFDC
AUC72.1
230
Deepfake DetectionDFD
AUC0.882
193
Deepfake DetectionCelebDF v2
AUC0.809
134
Deepfake DetectionDFDC (test)
AUC75.7
130
Deepfake DetectionCDF v2
AUC0.809
97
Deepfake DetectionCDFv1, CDFv2, DFD, DFDCP, DFDC (test)
Overall Average Score75.3
74
Face Forgery DetectionDFDC--
74
Deepfake DetectionCeleb-DF v2 (test)
Video-level AUC0.697
68
Deepfake DetectionFaceForensics++ (test)
AUC96.38
65
Image Deepfake DetectionDFo
AUC0.765
62
Showing 10 of 63 rows

Other info

Follow for update