Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization

About

Watermarking generative content serves as a vital tool for authentication, ownership protection, and mitigation of potential misuse. Existing watermarking methods face the challenge of balancing robustness and concealment. They empirically inject a watermark that is both invisible and robust and passively achieve concealment by limiting the strength of the watermark, thus reducing the robustness. In this paper, we propose to explicitly introduce a watermark hiding process to actively achieve concealment, thus allowing the embedding of stronger watermarks. To be specific, we implant a robust watermark in an intermediate diffusion state and then guide the model to hide the watermark in the final generated image. We employ an adversarial optimization algorithm to produce the optimal hiding prompt guiding signal for each watermark. The prompt embedding is optimized to minimize artifacts in the generated image, while the watermark is optimized to achieve maximum strength. The watermark can be verified by reversing the generation process. Experiments on various diffusion models demonstrate the watermark remains verifiable even under significant image tampering and shows superior invisibility compared to other state-of-the-art robust watermarking methods. Code is available at https://github.com/Hannah1102/ROBIN.

Huayang Huang, Yu Wu, Qian Wang• 2024

Related benchmarks

TaskDatasetResultRank
Watermark DetectionStable Diffusion-Prompts (SDP) 350 watermarked images
TPR@1%FPR100
108
Latent WatermarkingMS-COCO
FID24.61
9
Watermark VerificationWatermark Robustness Benchmark
Accuracy (No Attack)1
9
Computational EfficiencyGeneral Evaluation
Extraction Time (s)1.248
8
Watermarking EfficiencyStable Diffusion 512x512 (test)
Generation Time (s)2.682
7
Watermark Verificationreconstruction attack
AUC99.9
6
Watermark VerificationStable Diffusion 31
Verification Accuracy (Clean)100
6
Watermarking EfficiencyImagenet Diffusion 256x256 (test)
Generation Time (s)3.592
6
Watermark VerificationImageNet Diffusion
Accuracy (Clean)100
5
Watermarked Image Quality AssessmentStable Diffusion
SSIM76.8
3
Showing 10 of 12 rows

Other info

Code

Follow for update