Deep Audio Watermarks are Shallow: Limitations of Post-Hoc Watermarking Techniques for Speech
About
In the audio modality, state-of-the-art watermarking methods leverage deep neural networks to allow the embedding of human-imperceptible signatures in generated audio. The ideal is to embed signatures that can be detected with high accuracy when the watermarked audio is altered via compression, filtering, or other transformations. Existing audio watermarking techniques operate in a post-hoc manner, manipulating "low-level" features of audio recordings after generation (e.g. through the addition of a low-magnitude watermark signal). We show that this post-hoc formulation makes existing audio watermarks vulnerable to transformation-based removal attacks. Focusing on speech audio, we (1) unify and extend existing evaluations of the effect of audio transformations on watermark detectability, and (2) demonstrate that state-of-the-art post-hoc audio watermarks can be removed with no knowledge of the watermarking scheme and minimal degradation in audio quality.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Audio Quality Assessment | Clotho 1.0 (test) | ViSQOL4.347 | 10 | |
| Watermark Detection | Clotho 1.0 (test) | Perth100 | 10 | |
| Audio Watermark Removal | FMA small | ViSQOL Score4.109 | 10 | |
| Watermark Removal | LibriSpeech speech domain official releases (test) | SQUIM-MOS4.072 | 10 | |
| Watermark Removal | LibriSpeech SilentCipher (dev) | STOI94.4 | 4 | |
| Watermark Removal | LibriSpeech WavMark (dev) | STOI97.1 | 4 | |
| Watermark Removal | FMA WavMark | STOI96 | 4 | |
| Watermark Removal | VCTK AudioMarkNet | STOI94.7 | 4 | |
| Watermark Removal | LibriSpeech AudioSeal (dev) | STOI0.944 | 4 | |
| Watermark Removal | FMA SilentCipher | STOI0.932 | 4 |