Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Shallow Diffuse: Robust and Invisible Watermarking through Low-Dimensional Subspaces in Diffusion Models

About

The widespread use of AI-generated content from diffusion models has raised significant concerns regarding misinformation and copyright infringement. Watermarking is a crucial technique for identifying these AI-generated images and preventing their misuse. In this paper, we introduce Shallow Diffuse, a new watermarking technique that embeds robust and invisible watermarks into diffusion model outputs. Unlike existing approaches that integrate watermarking throughout the entire diffusion sampling process, Shallow Diffuse decouples these steps by leveraging the presence of a low-dimensional subspace in the image generation process. This method ensures that a substantial portion of the watermark lies in the null space of this subspace, effectively separating it from the image generation process. Our theoretical and empirical analyses show that this decoupling strategy greatly enhances the consistency of data generation and the detectability of the watermark. Extensive experiments further validate that our Shallow Diffuse outperforms existing watermarking methods in terms of robustness and consistency. The codes are released at https://github.com/liwd190019/Shallow-Diffuse.

Wenda Li, Huijie Zhang, Qing Qu• 2024

Related benchmarks

TaskDatasetResultRank
Watermark GenerationCOCO
PSNR32.11
21
Image WatermarkingDiffDB
PSNR33.07
17
Generative Image WatermarkingStable Diffusion Server Scenario v1-5 (test)
CLIP Score0.3669
10
Showing 3 of 3 rows

Other info

Follow for update