LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection
About
In this paper, we propose Localized Artifact Attention X (LAA-X), a novel deepfake detection framework that is both robust to high-quality forgeries and capable of generalizing to unseen manipulations. Existing approaches typically rely on binary classifiers coupled with implicit attention mechanisms, which often fail to generalize beyond known manipulations. In contrast, LAA-X introduces an explicit attention strategy based on a multi-task learning framework combined with blending-based data synthesis. Auxiliary tasks are designed to guide the model toward localized, artifact-prone (i.e., vulnerable) regions. The proposed framework is compatible with both CNN and transformer backbones, resulting in two different versions, namely, LAA-Net and LAA-Former, respectively. Despite being trained only on real and pseudo-fake samples, LAA-X competes with state-of-the-art methods across multiple benchmarks. Code and pre-trained weights for LAA-Net\footnote{https://github.com/10Ring/LAA-Net} and LAA-Former\footnote{https://github.com/10Ring/LAA-Former} are publicly available.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Deepfake Detection | CelebDF (CDF) v2 (test) | AUC95.4 | 52 | |
| Video-level Deepfake Detection | DeepFake Detection Challenge Preview (DFDCP) (test) | AUC96.3 | 21 | |
| Video-level Deepfake Detection | FaceForensics++ (FF++) (test) | AUC99.96 | 20 | |
| Deepfake Detection | CDF v2 (test) | Video-level AUC0.9093 | 19 | |
| Video-level Deepfake Detection | Google DeepFake Detection (DFD) (test) | AUC99.51 | 18 | |
| Video-level Deepfake Detection | DeepFake Detection Challenge (DFDC) (test) | AUC78.91 | 16 | |
| Video-level Deepfake Detection | WildDeepfake (DFW) (test) | AUC81.74 | 13 | |
| Deepfake Detection | DFDCP preview (test) | AUC91.58 | 10 | |
| Deepfake Detection | FaceForensics++ | Saturation Score99.96 | 9 | |
| Deepfake Detection | DiffSwap (test) | AUC93.73 | 9 |