Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

HiDDeN: Hiding Data With Deep Networks

About

Recent work has shown that deep neural networks are highly sensitive to tiny perturbations of input images, giving rise to adversarial examples. Though this property is usually considered a weakness of learned models, we explore whether it can be beneficial. We find that neural networks can learn to use invisible perturbations to encode a rich amount of useful information. In fact, one can exploit this capability for the task of data hiding. We jointly train encoder and decoder networks, where given an input message and cover image, the encoder produces a visually indistinguishable encoded image, from which the decoder can recover the original message. We show that these encodings are competitive with existing data hiding algorithms, and further that they can be made robust to noise: our models learn to reconstruct hidden information in an encoded image despite the presence of Gaussian blurring, pixel-wise dropout, cropping, and JPEG compression. Even though JPEG is non-differentiable, we show that a robust model can be trained using differentiable approximations. Finally, we demonstrate that adversarial training improves the visual quality of encoded images.

Jiren Zhu, Russell Kaplan, Justin Johnson, Li Fei-Fei• 2018

Related benchmarks

TaskDatasetResultRank
Image WatermarkingImageNet
Bit Accuracy (Overall)99
98
Watermark ExtractionCOCO
Bit Accuracy99
98
Watermark GenerationCOCO
PSNR28.5372
21
Image WatermarkingMS-COCO
PSNR30.3
21
Image WatermarkingDiffusionDB
PSNR30.8
17
WatermarkingScreen Camera (test)
Bit Accuracy74.5
16
Camera-based WatermarkingPrint Camera Distortions
Bit Accuracy67.1
16
Digital WatermarkingBlender and LLFF (test)
Bit Accuracy (No Attack)78.2
15
Secret image extractionLSUN Bedroom 256x256
PSNR27.13
10
Secret image extractionCIFAR10 32x32
PSNR25.24
10
Showing 10 of 29 rows

Other info

Follow for update