Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Diffusion Noise Feature: Accurate and Fast Generated Image Detection

About

Generative models now produce images with such stunning realism that they can easily deceive the human eye. While this progress unlocks vast creative potential, it also presents significant risks, such as the spread of misinformation. Consequently, detecting generated images has become a critical research challenge. However, current detection methods are often plagued by low accuracy and poor generalization. In this paper, to address these limitations and enhance the detection of generated images, we propose a novel representation, Diffusion Noise Feature (DNF). Derived from the inverse process of diffusion models, DNF effectively amplifies the subtle, high-frequency artifacts that act as fingerprints of artificial generation. Our key insight is that real and generated images exhibit distinct DNF signatures, providing a robust basis for differentiation. By training a simple classifier such as ResNet-50 on DNF, our approach achieves remarkable accuracy, robustness, and generalization in detecting generated images, including those from unseen generators or with novel content. Extensive experiments across four training datasets and five test sets confirm that DNF establishes a new state-of-the-art in generated image detection. The code is available at https://github.com/YichiCS/Diffusion-Noise-Feature.

Yichi Zhang, Xiaogang Xu• 2023

Related benchmarks

TaskDatasetResultRank
AI Image DetectionMidjourney
Accuracy87.32
51
Generated Image DetectionWukong
Accuracy86.8
41
AI-generated image detectionSD v1.5
Accuracy86.86
36
Generated Image DetectionADM
AP0.8372
29
AI-generated image detectionProGAN
mAP60.4
29
AI-generated image detectionCycleGAN
mAP66.49
29
AI-generated image detectionBigGAN
mAP51.75
29
AI-generated image detectionGauGAN
mAP39.48
29
AI-generated image detectionStyleGAN
mAP0.4418
29
AI-generated image detectionVQDM
Accuracy86.15
24
Showing 10 of 16 rows

Other info

Follow for update