Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

StegaStamp: Invisible Hyperlinks in Physical Photographs

About

Printed and digitally displayed photos have the ability to hide imperceptible digital data that can be accessed through internet-connected imaging systems. Another way to think about this is physical photographs that have unique QR codes invisibly embedded within them. This paper presents an architecture, algorithms, and a prototype implementation addressing this vision. Our key technical contribution is StegaStamp, a learned steganographic algorithm to enable robust encoding and decoding of arbitrary hyperlink bitstrings into photos in a manner that approaches perceptual invisibility. StegaStamp comprises a deep neural network that learns an encoding/decoding algorithm robust to image perturbations approximating the space of distortions resulting from real printing and photography. We demonstrates real-time decoding of hyperlinks in photos from in-the-wild videos that contain variation in lighting, shadows, perspective, occlusion and viewing distance. Our prototype system robustly retrieves 56 bit hyperlinks after error correction - sufficient to embed a unique code within every photo on the internet.

Matthew Tancik, Ben Mildenhall, Ren Ng• 2019

Related benchmarks

TaskDatasetResultRank
Watermark DetectionStable Diffusion-Prompts (SDP) 350 watermarked images
TPR@1%FPR95.7
108
Digital WatermarkingIndicSideFace 33
PSNR35.34
48
Image WatermarkingMS-COCO
PSNR29.8
28
Watermark GenerationCOCO
PSNR31.88
21
Watermark DecodingCOCO (subset)
Decoding Accuracy99.8
18
Image WatermarkingDiffusionDB
PSNR31.7
17
Image WatermarkingDiffDB
PSNR32.03
17
Camera-based WatermarkingPrint Camera Distortions
Bit Accuracy92.2
16
WatermarkingScreen Camera (test)
Bit Accuracy93.9
16
Watermark ExtractionCOCO (test)
Clean Success Rate92
10
Showing 10 of 28 rows

Other info

Follow for update