Toward Generalizable Forgery Detection and Reasoning
About
Accurate and interpretable detection of AI-generated images is essential for mitigating risks associated with AI misuse. However, the substantial domain gap among generative models makes it challenging to develop a generalizable forgery detection model. Moreover, since every pixel in an AI-generated image is synthesized, traditional saliency-based forgery explanation methods are not well suited for this task. To address these challenges, we formulate detection and explanation as a unified Forgery Detection and Reasoning task (FDR-Task), leveraging Multi-Modal Large Language Models (MLLMs) to provide accurate detection through reliable reasoning over forgery attributes. To facilitate this task, we introduce the Multi-Modal Forgery Reasoning dataset (MMFR-Dataset), a large-scale dataset containing 120K images across 10 generative models, with 378K reasoning annotations on forgery attributes, enabling comprehensive evaluation of the FDR-Task. Furthermore, we propose FakeReasoning, a forgery detection and reasoning framework with three key components: 1) a dual-branch visual encoder that integrates CLIP and DINO to capture both high-level semantics and low-level artifacts; 2) a Forgery-Aware Feature Fusion Module that leverages DINO's attention maps and cross-attention mechanisms to guide MLLMs toward forgery-related clues; 3) a Classification Probability Mapper that couples language modeling and forgery detection, enhancing overall performance. Experiments across multiple generative models demonstrate that FakeReasoning not only achieves robust generalization but also outperforms state-of-the-art methods on both detection and reasoning tasks. The code is available at: https://github.com/PRIS-CV/FakeReasoning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Deepfake Detection | Celeb-DF | ROC-AUC0.7394 | 44 | |
| Deepfake Detection | FF++ LQ | Accuracy92.79 | 14 | |
| Image Forgery Detection | CommunityForensic-Eval | R-Acc83.6 | 12 | |
| Image Forgery Detection | LOKI | R-Acc63.89 | 12 | |
| Image Forgery Detection | Bfree (test) | R-Accuracy51.32 | 12 | |
| Forgery Detection | MMFR-Dataset | SD Score99.2 | 11 | |
| Forgery Detection | FDR-Task | DM94.08 | 7 | |
| Forgery Reasoning | FDR-Task | BL-10.37 | 7 |