DiffusionPrint: Learning Generative Fingerprints for Diffusion-Based Inpainting Localization
About
Modern diffusion-based inpainting models pose significant challenges for image forgery localization (IFL), as their full regeneration pipelines reconstruct the entire image via a latent decoder, disrupting the camera-level noise patterns that existing forensic methods rely on. We propose DiffusionPrint, a patch-level contrastive learning framework that learns a forensic signal robust to the spectral distortions introduced by latent decoding. It exploits the fact that inpainted regions generated by the same model share a consistent generative fingerprint, using this as a self-supervisory signal. DiffusionPrint trains a convolutional backbone via a MoCo-style objective with cross-category hard negative mining and a generator-aware classification head, producing a forensic feature map that serves as a highly discriminative secondary modality in fusion-based IFL frameworks. Integrated into TruFor, MMFusion, and a lightweight fusion baseline, DiffusionPrint consistently improves localization across multiple generative models, with gains of up to +28% on mask types unseen during fine-tuning and confirmed generalization to unseen generative architectures. Code is available at https://github.com/mever-team/diffusionprint
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Forgery Localization | TGIF FR semantic SD 2.1 | F1 Score54 | 9 | |
| Forgery Localization | TGIF FR SD 2.1 (random) | F1 Score25 | 9 | |
| Forgery Localization | TGIF FR SDXL semantic | F1 Score67 | 9 | |
| Forgery Localization | TGIF FR (SDXL) (random) | F1 Score73 | 9 | |
| Forgery Localization | TGIF FR Flux schnell semantic | F1 Score89 | 9 | |
| Forgery Localization | TGIF FR Flux schnell (random) | F1 Score85 | 9 | |
| Forgery Localization | TGIF FR Flux semantic (dev) | F1 Score83 | 9 | |
| Forgery Localization | TGIF FR Flux random (dev) | F1 Score (%)78 | 9 | |
| Forgery Localization | TGIF FR (Flux fill) semantic | F1 Score76 | 9 | |
| Forgery Localization | TGIF FR Flux fill random | F1 Score78 | 9 |