XAttnMark: Learning Robust Audio Watermarking with Cross-Attention
About
The rapid proliferation of generative audio synthesis and editing technologies has raised serious concerns about copyright infringement, data provenance, and the spread of misinformation via deepfake audio. Watermarking offers a proactive solution by embedding imperceptible yet identifiable and traceable signals into audio content. While recent neural network-based watermarking methods like WavMark and AudioSeal have improved robustness and quality, they struggle to jointly optimize both robust detection and accurate attribution. This paper introduces Cross-Attention Robust Audio Watermark (XATTNMARK), which bridges this gap by leveraging partial parameter sharing between the generator and the detector, a cross-attention mechanism for efficient message retrieval, and a temporal conditioning module for improved message distribution. Additionally, we propose a psychoacoustic-aligned time-frequency (TF) masking loss that captures fine-grained auditory masking effects, improving watermark imperceptibility. XATTNMARK achieves state-of-the-art performance in both detection and attribution, demonstrating superior robustness against a wide range of audio transformations, including challenging generative editing at varying strengths. This work advances audio watermarking for protecting intellectual property and ensuring authenticity in the era of generative AI.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Audio Watermarking Attribution | MusicCaps | Accuracy (Att.) (%)100 | 352 | |
| Audio Watermark Attribution | MusicCaps (test) | Attribution Accuracy100 | 85 | |
| Audio Watermark Detection | MusicCaps balanced (val) | Accuracy99.5 | 85 | |
| Audio Watermark Detection | MusicCaps (test) | Detection Accuracy99.5 | 85 | |
| Audio Watermark Detection | Stable Audio generative edits (test) | Accuracy94 | 33 | |
| Audio Watermark Detection | AudioLDM2-Music generative edits (test) | Accuracy93.75 | 18 | |
| Audio Watermark Detection | AudioLDM2 generative edits (test) | Accuracy94 | 15 | |
| Audio Watermarking Attribution | VoxPopuli | FAR (%)5.03 | 12 | |
| Watermark Detection | AudioMarkBench | Accuracy68 | 10 | |
| Audio Perceptual Quality Assessment | audio evaluation dataset (test) | SI-SNR29 | 7 |