From Spurious to Causal: Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detection
About
The generalization problem remains a critical challenge in face forgery detection. Some researches have discovered that ``a backdoor path" in the representations from forgery-irrelevant information to labels induces biased learning, thereby hindering the generalization. In this paper, these forgery-irrelevant information are collectively termed spurious correlations factors. Previous methods predominantly focused on identifying concrete, specific spurious correlation and designing corresponding solutions to address them. However, spurious correlations arise from unobservable confounding factors, making it impractical to identify and address each one individually. To address this, we propose an intervention paradigm for representation space. Instead of tracking and blocking various instance-level spurious correlation one by one, we uniformly model them as a low-rank subspace and intervene in them. Specifically, we decompose spurious correlation features into a low-rank subspace via orthogonal low-rank projection, subsequently removing this subspace from the original representation and training its orthogonal complement to capture forgery-related features. This low-rank projection removal effectively eliminates spurious correlation factors, ensuring that classification decision is based on authentic forgery cues. With only 0.43M trainable parameters, our method achieves state-of-the-art performance across several benchmarks, demonstrating excellent robustness and generalization.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Face Forgery Detection | DFDC | AUC85.3 | 25 | |
| Face Forgery Detection | CDF v2 | Frame-level AUC90.1 | 15 | |
| Face Forgery Detection | DFDCP | Frame-level AUC90.5 | 15 | |
| Face Forgery Detection | DFD | Frame-level AUC92.6 | 14 | |
| Face Forgery Detection | CDF v1 | Frame-level AUC92.4 | 13 | |
| Face Forgery Detection | CDF v2 | Video AUC0.948 | 11 | |
| Face Forgery Detection | DF40 latest (test) | UniFace92.5 | 10 | |
| Face Forgery Detection | DFDCP | Video-level AUC0.929 | 8 |