Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Latent-Mark: An Audio Watermark Robust to Neural Resynthesis

About

While existing audio watermarking techniques have achieved strong robustness against traditional digital signal processing (DSP) attacks, they remain vulnerable to neural resynthesis. This occurs because modern neural audio codecs act as semantic filters and discard the imperceptible waveform variations used in prior watermarking methods. To address this limitation, we propose Latent-Mark, the first zero-bit audio watermarking framework designed to survive semantic compression. Our key insight is that robustness to the encode-decode process requires embedding the watermark within the codec's invariant latent space. We achieve this by optimizing the audio waveform to induce a detectable directional shift in its encoded latent representation, while constraining perturbations to align with the natural audio manifold to ensure imperceptibility. To prevent overfitting to a single codec's quantization rules, we introduce Cross-Codec Optimization, jointly optimizing the waveform across multiple surrogate codecs to target shared latent invariants. Extensive evaluations demonstrate robust zero-shot transferability to unseen neural codecs, achieving state-of-the-art resilience against traditional DSP attacks while preserving perceptual imperceptibility. Our work inspires future research into universal watermarking frameworks capable of maintaining integrity across increasingly complex and diverse generative distortions.

Yen-Shan Chen, Shih-Yu Lai, Ying-Jung Tsou, Yi-Cheng Lin, Bing-Yu Chen, Yun-Nung Chen, Hung-yi Lee, Shang-Tse Chen• 2026

Related benchmarks

TaskDatasetResultRank
Audio WatermarkingLibriSpeech
Detection Accuracy100
23
Audio WatermarkingjaCappella
Survivability Rate100
23
Audio WatermarkingGuitarSet
Survivability Detection Rate100
23
Watermark RobustnessAIR
Survivability100
16
Watermark RobustnessFreischuetz
Survivability71.23
16
Audio WatermarkingAIR
Detectability Accuracy100
7
Audio WatermarkingPCD
Detection Accuracy100
7
Audio WatermarkingMAESTRO
Detectability Accuracy100
7
Audio WatermarkingClotho
Detectability Accuracy96.7
7
Audio WatermarkingDAPS
Detection Accuracy99.2
7
Showing 10 of 10 rows

Other info

Follow for update