Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Attack-Resilient Image Watermarking Using Stable Diffusion

About

Watermarking images is critical for tracking image provenance and proving ownership. With the advent of generative models, such as stable diffusion, that can create fake but realistic images, watermarking has become particularly important to make human-created images reliably identifiable. Unfortunately, the very same stable diffusion technology can remove watermarks injected using existing methods. To address this problem, we present ZoDiac, which uses a pre-trained stable diffusion model to inject a watermark into the trainable latent space, resulting in watermarks that can be reliably detected in the latent vector even when attacked. We evaluate ZoDiac on three benchmarks, MS-COCO, DiffusionDB, and WikiArt, and find that ZoDiac is robust against state-of-the-art watermark attacks, with a watermark detection rate above 98% and a false positive rate below 6.4%, outperforming state-of-the-art watermarking methods. We hypothesize that the reciprocating denoising process in diffusion models may inherently enhance the robustness of the watermark when faced with strong attacks and validate the hypothesis. Our research demonstrates that stable diffusion is a promising approach to robust watermarking, able to withstand even stable-diffusion--based attack methods. ZoDiac is open-sourced and available at https://github.com/zhanglijun95/ZoDiac.

Lijun Zhang, Xiao Liu, Antoni Viros Martin, Cindy Xiong Bearfield, Yuriy Brun, Hui Guan• 2024

Related benchmarks

TaskDatasetResultRank
Watermark DetectionStable Diffusion-Prompts (SDP) 350 watermarked images
TPR@1%FPR100
108
Image WatermarkingMS-COCO
PSNR29.41
21
Image WatermarkingDiffDB
PSNR29.18
17
Watermark VerificationWatermark Robustness Benchmark
Accuracy (No Attack)1
9
Latent WatermarkingMS-COCO--
9
Computational EfficiencyGeneral Evaluation
Extraction Time (s)3.601
8
Image WatermarkingWikiArt
PSNR30.04
8
Showing 7 of 7 rows

Other info

Code

Follow for update