Transferable Multi-Bit Watermarking Across Frozen Diffusion Models via Latent Consistency Bridges
About
As generative AI advances, global governance frameworks increasingly mandate verifiable content provenance. However, existing watermarking techniques face a critical policy-to-technology disconnect: sampling-based methods require computationally prohibitive inversion, while fine-tuning approaches are tethered to specific model checkpoints, hindering standardized, cross-model oversight. To bridge this gap, we introduce DiffMark, a plug-and-play multi-bit watermarking framework. DiffMark embeds a persistent, learned perturbation into every denoising step of a frozen diffusion model, accumulating a recoverable signal in the final latent space. To enable efficient training through the frozen network, we utilize Latent Consistency Models (LCMs) as a differentiable training bridge. DiffMark achieves 64-bit extraction in a single 16.4 ms forward pass, which is a $45\times$ speed-up over inversion baselines. By enabling per-image key flexibility and cross-architecture transferability without retraining, DiffMark provides the practical, scalable technical tooling necessary to operationalize user accountability and enforce emerging AI governance mandates.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Watermarking | MS-COCO | PSNR8.91 | 28 | |
| Image Watermarking | DALL-E 3 | PSNR9.75 | 7 | |
| Watermark Robustness | DiffusionDB | Brightness Robustness100 | 7 | |
| Watermark Robustness | DALL-E 3 | Robustness: Brightness100 | 7 |