Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CORE: Consistent Representation Learning for Face Forgery Detection

About

Face manipulation techniques develop rapidly and arouse widespread public concerns. Despite that vanilla convolutional neural networks achieve acceptable performance, they suffer from the overfitting issue. To relieve this issue, there is a trend to introduce some erasing-based augmentations. We find that these methods indeed attempt to implicitly induce more consistent representations for different augmentations via assigning the same label for different augmented images. However, due to the lack of explicit regularization, the consistency between different representations is less satisfactory. Therefore, we constrain the consistency of different representations explicitly and propose a simple yet effective framework, COnsistent REpresentation Learning (CORE). Specifically, we first capture the different representations with different augmentations, then regularize the cosine distance of the representations to enhance the consistency. Extensive experiments (in-dataset and cross-dataset) demonstrate that CORE performs favorably against state-of-the-art face forgery detection methods.

Yunsheng Ni, Depu Meng, Changqian Yu, Chengbin Quan, Dongchun Ren, Youjian Zhao• 2022

Related benchmarks

TaskDatasetResultRank
Deepfake DetectionDFDC
AUC72.1
150
Deepfake DetectionDFDC (test)
AUC75.7
122
Deepfake DetectionDFD
AUC0.882
91
Deepfake DetectionCDFv1, CDFv2, DFD, DFDCP, DFDC (test)
Overall Average Score75.3
74
Deepfake DetectionCelebDF v2
AUC0.743
57
Deepfake DetectionDFDCP (test)--
55
Face Forgery DetectionDFDC--
52
Deepfake DetectionCeleb-DF v2 (test)
Video-level AUC0.697
48
Deepfake DetectionDeepfakeDetection (DFD) (test)
AUC86.8
43
Deepfake DetectionFF++ video-level 8 (test)
Accuracy94.8
40
Showing 10 of 45 rows

Other info

Follow for update