StegaStamp: Invisible Hyperlinks in Physical Photographs
About
Printed and digitally displayed photos have the ability to hide imperceptible digital data that can be accessed through internet-connected imaging systems. Another way to think about this is physical photographs that have unique QR codes invisibly embedded within them. This paper presents an architecture, algorithms, and a prototype implementation addressing this vision. Our key technical contribution is StegaStamp, a learned steganographic algorithm to enable robust encoding and decoding of arbitrary hyperlink bitstrings into photos in a manner that approaches perceptual invisibility. StegaStamp comprises a deep neural network that learns an encoding/decoding algorithm robust to image perturbations approximating the space of distortions resulting from real printing and photography. We demonstrates real-time decoding of hyperlinks in photos from in-the-wild videos that contain variation in lighting, shadows, perspective, occlusion and viewing distance. Our prototype system robustly retrieves 56 bit hyperlinks after error correction - sufficient to embed a unique code within every photo on the internet.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Watermark Detection | Stable Diffusion-Prompts (SDP) 350 watermarked images | TPR@1%FPR95.7 | 108 | |
| Watermark Generation | COCO | PSNR31.88 | 21 | |
| Image Watermarking | MS-COCO | PSNR29.8 | 21 | |
| Watermark Decoding | COCO (subset) | Decoding Accuracy99.8 | 18 | |
| Image Watermarking | DiffusionDB | PSNR31.7 | 17 | |
| Image Watermarking | DiffDB | PSNR32.03 | 17 | |
| Camera-based Watermarking | Print Camera Distortions | Bit Accuracy92.2 | 16 | |
| Watermarking | Screen Camera (test) | Bit Accuracy93.9 | 16 | |
| Watermark Extraction | COCO (test) | Clean Success Rate92 | 10 | |
| Watermark Extraction | DiffusionDB (test) | Clean Success Rate0.91 | 10 |