Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection

About

Face forgery detection is raising ever-increasing interest in computer vision since facial manipulation technologies cause serious worries. Though recent works have reached sound achievements, there are still unignorable problems: a) learned features supervised by softmax loss are separable but not discriminative enough, since softmax loss does not explicitly encourage intra-class compactness and interclass separability; and b) fixed filter banks and hand-crafted features are insufficient to capture forgery patterns of frequency from diverse inputs. To compensate for such limitations, a novel frequency-aware discriminative feature learning framework is proposed in this paper. Specifically, we design a novel single-center loss (SCL) that only compresses intra-class variations of natural faces while boosting inter-class differences in the embedding space. In such a case, the network can learn more discriminative features with less optimization difficulty. Besides, an adaptive frequency feature generation module is developed to mine frequency clues in a completely data-driven fashion. With the above two modules, the whole framework can learn more discriminative features in an end-to-end manner. Extensive experiments demonstrate the effectiveness and superiority of our framework on three versions of the FF++ dataset.

Jiaming Li, Hongtao Xie, Jiahong Li, Zhongyuan Wang, Yongdong Zhang• 2021

Related benchmarks

TaskDatasetResultRank
Fake Face DetectionCeleb-DF v2 (test)
AUC65.2
50
Deepfake DetectionFF++ Intra-dataset c23
AUC99.28
24
Deepfake DetectionFF++ Intra-dataset (c40)
Accuracy89
15
Face Forgery DetectionFaceForensics++ (FF++) c23 light compression
Accuracy96.69
9
Face Forgery DetectionFaceForensics++ heavy compression c40
Accuracy89
9
Face Forgery DetectionFaceForensics++ raw (c0)
Accuracy99.43
8
Showing 6 of 6 rows

Other info

Follow for update