Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Error

About

The rapid advancement of diffusion models has significantly improved high-quality image generation, making generated content increasingly challenging to distinguish from real images and raising concerns about potential misuse. In this paper, we observe that diffusion models struggle to accurately reconstruct mid-band frequency information in real images, suggesting the limitation could serve as a cue for detecting diffusion model generated images. Motivated by this observation, we propose a novel method called Frequency-guided Reconstruction Error (FIRE), which, to the best of our knowledge, is the first to investigate the influence of frequency decomposition on reconstruction error. FIRE assesses the variation in reconstruction error before and after the frequency decomposition, offering a robust method for identifying diffusion model generated images. Extensive experiments show that FIRE generalizes effectively to unseen diffusion models and maintains robustness against diverse perturbations.

Beilin Chu, Xuan Xu, Xin Wang, Yufei Zhang, Weike You, Linna Zhou• 2024

Related benchmarks

TaskDatasetResultRank
AI-generated image detectionCelebA-HQ v2 (test)
ACC99.95
40
AI-generated image detectionImageNet 1k (test)
Accuracy53.15
20
Image Generation DetectionDiffusionForensics ImageNet SD v1
AUC100
10
Image Generation DetectionDiffusionForensics ImageNet ADM
AUC100
10
Image Generation DetectionDiffusionForensics LSUN-Bedroom (DDPM)
AUC100
10
Image Generation DetectionDiffusionForensics LSUN-Bedroom PNDM
AUC100
10
Image Generation DetectionDiffusionForensics LSUN-Bedroom SD-v1
AUC100
10
Image Generation DetectionDiffusionForensics LSUN-Bedroom Midjourney
AUC100
10
Image Generation DetectionDiffusionForensics LSUN-Bedroom IDDPM
AUC100
10
Image Generation DetectionDiffusionForensics LSUN-Bedroom SD v2
AUC100
10
Showing 10 of 15 rows

Other info

Follow for update