Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CORE: Consistent Representation Learning for Face Forgery Detection

About

Face manipulation techniques develop rapidly and arouse widespread public concerns. Despite that vanilla convolutional neural networks achieve acceptable performance, they suffer from the overfitting issue. To relieve this issue, there is a trend to introduce some erasing-based augmentations. We find that these methods indeed attempt to implicitly induce more consistent representations for different augmentations via assigning the same label for different augmented images. However, due to the lack of explicit regularization, the consistency between different representations is less satisfactory. Therefore, we constrain the consistency of different representations explicitly and propose a simple yet effective framework, COnsistent REpresentation Learning (CORE). Specifically, we first capture the different representations with different augmentations, then regularize the cosine distance of the representations to enhance the consistency. Extensive experiments (in-dataset and cross-dataset) demonstrate that CORE performs favorably against state-of-the-art face forgery detection methods.

Yunsheng Ni, Depu Meng, Changqian Yu, Chengbin Quan, Dongchun Ren, Youjian Zhao• 2022

Related benchmarks

TaskDatasetResultRank
Deepfake DetectionDFDC
AUC72.1
135
Deepfake DetectionDFDC (test)
AUC75.7
87
Deepfake DetectionDFD
AUC0.882
77
Deepfake DetectionCDFv1, CDFv2, DFD, DFDCP, DFDC (test)
DFD Score80.2
42
Deepfake DetectionFF++ video-level 8 (test)
Accuracy94.8
40
Deepfake DetectionCelebDF v2
AUC0.743
40
Deepfake DetectionFaceForensics++ c23 (train)
FF c23 Score96.38
31
Deepfake DetectionCross-Domain Evaluation (test)
CDFv1 Score77.98
31
Deepfake DetectionCeleb-DF 9 (test)
Accuracy95.3
30
Deepfake DetectionDFDC 10 (test)
Accuracy95
30
Showing 10 of 26 rows

Other info

Follow for update