Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ForgeLens: Data-Efficient Forgery Focus for Generalizable Forgery Image Detection

About

The rise of generative models has raised concerns about image authenticity online, highlighting the urgent need for a detector that is (1) highly generalizable, capable of handling unseen forgery techniques, and (2) data-efficient, achieving optimal performance with minimal training data, enabling it to counter newly emerging forgery techniques effectively. To achieve this, we propose ForgeLens, a data-efficient, feature-guided framework that incorporates two lightweight designs to enable a frozen network to focus on forgery-specific features. First, we introduce the Weight-Shared Guidance Module (WSGM), which guides the extraction of forgery-specific features during training. Second, a forgery-aware feature integrator, FAFormer, is used to effectively integrate forgery information across multi-stage features. ForgeLens addresses a key limitation of previous frozen network-based methods, where general-purpose features extracted from large datasets often contain excessive forgery-irrelevant information. As a result, it achieves strong generalization and reaches optimal performance with minimal training data. Experimental results on 19 generative models, including both GANs and diffusion models, demonstrate improvements of 13.61% in Avg.Acc and 8.69% in Avg.AP over the base model. Notably, ForgeLens outperforms existing forgery detection methods, achieving state-of-the-art performance with just 1% of the training data. Our code is available at https://github.com/Yingjian-Chen/ForgeLens.

Yingjian Chen, Lei Zhang, Yakun Niu• 2024

Related benchmarks

TaskDatasetResultRank
Generated Image DetectionGenImage (test)--
124
AI-generated image detectionGenImage--
106
Synthetic Image DetectionDRCT-2M
LDM100
35
Synthetic Image DetectionUFD
Pro-GAN Performance100
24
AI-generated image detectionMGD
Accuracy95.3
15
AI-generated image detectionUDF
Accuracy95.4
15
AI-generated image detectionCNNDF
Accuracy96
15
AI-generated image detectionAverage (AVG)
Accuracy84.1
15
AI-generated image detectionDIRE
Accuracy83.1
15
AI-generated image detectionGANDF
Accuracy89.2
15
Showing 10 of 11 rows

Other info

Follow for update