Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Mental Damage: Caption Poisoning Attacks on Retrieval-Augmented Text-to-Music Generation

About

Retrieval-augmented text-to-music (TTM) systems augment underspecified user prompts using captions retrieved from a music caption dataset. This design introduces an integrity dependency on the music knowledge database. We show that an attacker can poison the database by injecting a small number of crafted music captions, causing the system to retrieve malicious captions that bias prompt augmentation and steer generation away from the user's intended function, without modifying the user prompt, retriever, or generator. To achieve the music caption poisoning attack, we propose a dual-layer caption poisoning strategy that preserves high-level retrieval anchors while injecting low-level acoustic descriptors to steer prompt augmentation and downstream music generation toward an attacker-chosen target intent. In a MusicCaps knowledge database, CLAP retriever, and MusicGen pipeline, poisoned generations move substantially closer to the attacker's target, while remaining comparably aligned with the original user query. These results expose a practical integrity risk for retrieval-augmented creative AI systems. Our demo can be found at: https://yizhu-wen.github.io/Mental-Damage/

Yizhu Wen, Shuhao Zhang, Nan Zhang, Long Cheng, Hanqing Guo• 2026

Related benchmarks

TaskDatasetResultRank
Music RetrievalMusicCaps
Precision98
3
Text-to-Music GenerationMusicCaps
CLAP Similarity (Benign, User Question)0.33
3
Showing 2 of 2 rows

Other info

Follow for update