OSI: One-step Inversion Excels in Extracting Diffusion Watermarks
About
Watermarking is an important mechanism for provenance and copyright protection of diffusion-generated images. Training-free methods, exemplified by Gaussian Shading, embed watermarks into the initial noise of diffusion models with negligible impact on the quality of generated images. However, extracting this type of watermark typically requires multi-step diffusion inversion to obtain precise initial noise, which is computationally expensive and time-consuming. To address this issue, we propose One-step Inversion (OSI), a significantly faster and more accurate method for extracting Gaussian Shading style watermarks. OSI reformulates watermark extraction as a learnable sign classification problem, which eliminates the need for precise regression of the initial noise. Then, we initialize the OSI model from the diffusion backbone and finetune it on synthesized noise-image pairs with a sign classification objective. In this manner, the OSI model is able to accomplish the watermark extraction efficiently in only one step. Our OSI substantially outperforms the multi-step diffusion inversion method: it is 20x faster, achieves higher extraction accuracy, and doubles the watermark payload capacity. Extensive experiments across diverse schedulers, diffusion backbones, and cryptographic schemes consistently show improvements, demonstrating the generality of our OSI framework.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Watermarking | Stable Diffusion V2.1 | Bit Acc.1 | 20 | |
| Watermark Extraction | SD 3.5 | Clean Bit Accuracy99.93 | 8 | |
| Watermark Extraction | SDXL | Clean Extraction Rate100 | 8 | |
| Watermark Extraction | SD2.1 (Adversarial) | Bit Accuracy97.58 | 8 | |
| Watermark Extraction | SD Compression Attack 2.1 | Bit Accuracy95.84 | 8 | |
| Watermark Extraction | MS-COCO 2017 (test) | Clean Accuracy100 | 8 | |
| Watermark Extraction | SD2.1 SDP 1k prompts | TPR @ FPR=1e-6 (Clean)1 | 8 | |
| Watermark Extraction | SD Clean 2.1 | Success Rate (Res 256)1 | 2 |