Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Watermark Anything with Localized Messages

About

Image watermarking methods are not tailored to handle small watermarked areas. This restricts applications in real-world scenarios where parts of the image may come from different sources or have been edited. We introduce a deep-learning model for localized image watermarking, dubbed the Watermark Anything Model (WAM). The WAM embedder imperceptibly modifies the input image, while the extractor segments the received image into watermarked and non-watermarked areas and recovers one or several hidden messages from the areas found to be watermarked. The models are jointly trained at low resolution and without perceptual constraints, then post-trained for imperceptibility and multiple watermarks. Experiments show that WAM is competitive with state-of-the art methods in terms of imperceptibility and robustness, especially against inpainting and splicing, even on high-resolution images. Moreover, it offers new capabilities: WAM can locate watermarked areas in spliced images and extract distinct 32-bit messages with less than 1 bit error from multiple small regions -- no larger than 10% of the image surface -- even for small 256x256 images. Training and inference code and model weights are available at https://github.com/facebookresearch/watermark-anything.

Tom Sander, Pierre Fernandez, Alain Durmus, Teddy Furon, Matthijs Douze• 2024

Related benchmarks

TaskDatasetResultRank
Digital WatermarkingIndicSideFace 33
PSNR42.25
48
Image Quality EvaluationCelebA-HQ
PSNR43.47
25
Tamper LocalizationCelebA-HQ SD Inpainting (1,000 images)
F1 Score49.5
11
Tamper LocalizationCelebA-HQ Splicing (1,000 images)
F1 Score78.2
11
Tamper LocalizationCelebA-HQ HD-painter
F1 Score17.4
11
Image WatermarkingImage Watermarking (test)
FPS38.4982
10
Watermark ExtractionCelebA-HQ
InfoSwap Robustness99.64
9
Robustness EvaluationSA-1b photos
Identity Bit Accuracy100
9
Robustness EvaluationMeta AI images
Identity Bit Acc100
9
Watermark Imperceptibility EvaluationMeta AI 1000 images (test)
PSNR41.4
9
Showing 10 of 19 rows

Other info

Follow for update