AEGIS: Adversarial Target-Guided Retention-Data-Free Robust Concept Erasure from Diffusion Models
About
Concept erasure helps stop diffusion models (DMs) from generating harmful content; but current methods face robustness retention trade off. Robustness means the model fine-tuned by concept erasure methods resists reactivation of erased concepts, even under semantically related prompts. Retention means unrelated concepts are preserved so the model's overall utility stays intact. Both are critical for concept erasure in practice, yet addressing them simultaneously is challenging, as existing works typically improve one factor while sacrificing the other. Prior work typically strengthens one while degrading the other, e.g., mapping a single erased prompt to a fixed safe target leaves class level remnants exploitable by prompt attacks, whereas retention-oriented schemes underperform against adaptive adversaries. This paper introduces Adversarial Erasure with Gradient Informed Synergy (AEGIS), a retention-data-free framework that advances both robustness and retention.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Concept Erasure | Stable Diffusion Church object v1.4 | ASR10.28 | 13 | |
| Concept Erasure | Van Gogh style | ASR10.36 | 12 | |
| Concept Erasure | Stable Diffusion Nudity Concept v1.4 | ASR 112.06 | 12 | |
| Concept Erasure | SD Van Gogh v2.1 | ASR140 | 9 | |
| Object Unlearning | COCO-10k Garbage Truck concept base model v1.4 (val) | ASR 114 | 9 | |
| Concept Erasure | SD Nudity v2.1 | ASR 135.92 | 9 | |
| Concept Erasure | SD Church v2.1 | ASR 134 | 9 | |
| Object Unlearning | COCO 10k Parachute concept base model v1.4 (val) | ASR10.34 | 9 | |
| Object Unlearning | COCO-10k Tench concept v1.4 base model (val) | ASR120 | 9 | |
| Concept Erasure | Nudity concept | Pre-ASR6.38 | 5 |