Probing Token Spaces under Generator Shift in AI-Generated Music Detection
About
AI-generated music detectors can appear robust on standard benchmark splits, yet their deployments require transfer to generator sources absent during training. We study this problem with source-restricted evaluation on \textsc{MoM-open}, an open reconstruction of MoM-CLAM that replaces the non-redistributable real corpus with FMA and MTG-Jamendo while preserving the fake-generator protocol. To isolate the role of representation, we introduce \textsc{CoMoE}, a compact fixed classifier for comparing heterogeneous audio token spaces while keeping the downstream architecture and training recipe unchanged. Experiments show that standard and real-source-restricted splits are nearly saturated, whereas fake-source restriction exposes large differences between token spaces: X-Codec tokens are strongest when training on Udio alone, while MERT-derived tokens are stronger when training on Suno-v3.5 alone. These results suggest that codec-style discrete token spaces should be treated as a primary experimental axis under generator shift in AI-generated music detection. Our code and data are available at https://github.com/MAAP-LAB/CoMoE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| AI-Generated Music Detection | MOM-OPEN FAKE-UDIO | Held-out Fake Detection Rate45.1 | 7 | |
| AI-Generated Music Detection | MOM-OPEN base | OOD AUC99.93 | 7 | |
| AI-Generated Music Detection | MOM-OPEN FAKE-SUNO3.5 | Held-out-fake Detection Rate61.4 | 7 | |
| AI-Generated Music Detection | MOM-OPEN REAL-FMA | OOD AUC99.62 | 7 | |
| AI-Generated Music Detection | MOM-OPEN REAL-JAMENDO | OOD AUC99.73 | 7 | |
| AI-Generated Music Detection | MOM-OPEN FAKE-SUNO3.5 | OOD AUC92.22 | 7 |