Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning

About

The proliferation of synthetic facial imagery has intensified the need for robust Open-World DeepFake Attribution (OW-DFA), which aims to attribute both known and unknown forgeries using labeled data for known types and unlabeled data containing a mixture of known and novel types. However, existing OW-DFA methods face two critical limitations: 1) A confidence skew that leads to unreliable pseudo-labels for novel forgeries, resulting in biased training. 2) An unrealistic assumption that the number of unknown forgery types is known *a priori*. To address these challenges, we propose a Confidence-Aware Asymmetric Learning (CAL) framework, which adaptively balances model confidence across known and novel forgery types. CAL mainly consists of two components: Confidence-Aware Consistency Regularization (CCR) and Asymmetric Confidence Reinforcement (ACR). CCR mitigates pseudo-label bias by dynamically scaling sample losses based on normalized confidence, gradually shifting the training focus from high- to low-confidence samples. ACR complements this by separately calibrating confidence for known and novel classes through selective learning on high-confidence samples, guided by their confidence gap. Together, CCR and ACR form a mutually reinforcing loop that significantly improves the model's OW-DFA performance. Moreover, we introduce a Dynamic Prototype Pruning (DPP) strategy that automatically estimates the number of novel forgery types in a coarse-to-fine manner, removing the need for unrealistic prior assumptions and enhancing the scalability of our methods to real-world OW-DFA scenarios. Extensive experiments on the standard OW-DFA benchmark and a newly extended benchmark incorporating advanced manipulations demonstrate that CAL consistently outperforms previous methods, achieving new state-of-the-art performance on both known and novel forgery attribution.

Haiyang Zheng, Nan Pu, Wenjing Li, Teng Long, Nicu Sebe, Zhun Zhong• 2025

Related benchmarks

TaskDatasetResultRank
Deep Face AttributionOW-DFA (All)
Accuracy88.4
18
Deep Face AttributionOW-DFA (Novel)
Accuracy81.2
18
Deep Face AttributionOW-DFA Known
ACC0.975
18
Deepfake AttributionOW-DFA-40 Protocol-1
All Accuracy88.3
10
Deepfake AttributionOW-DFA-40 Protocol-2
All Accuracy82.8
10
Deepfake AttributionOW-DFA-40 Protocol-3
All ACC91.5
10
Showing 6 of 6 rows

Other info

Follow for update