Dynamic Eraser for Guided Concept Erasure in Diffusion Models
About
Concept erasure in Text-To-Image (T2I) diffusion models is vital for safe content generation, but existing inference-time methods face significant limitations. Feature-correction approaches often cause uncontrolled over-correction, while token-level interventions struggle with semantic granularity and context. Moreover, both types of methods are prone to severe semantic drift or even complete representation collapse. To address these challenges, we present Dynamic Semantic Steering (DSS), a lightweight, training-free framework for interpretable and controllable concept erasure. DSS introduces: 1) Sensitive Semantic Boundary Modeling (SSBM) to automate the discovery of safe semantic anchors, and 2) Sensitive Semantic Guidance (SSG), which leverages cross-attention features for precise detection and performs correction via a closed-form solution derived from a well-posed objective. This ensures optimal suppression of sensitive content while preserving benign semantics. DSS achieves an average erasure rate of 91.0\%, significantly outperforming SOTA methods (from 18.6\% to 85.9\%) with minimal impact on output fidelity.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Concept Erasure | NSFW Concepts | Sexually Concept Accuracy0.6 | 14 | |
| Concept Erasure | Object Concepts | Car Accuracy5 | 12 | |
| Concept Erasure | Painting Style Concepts | Erasure Success (Van Gogh)0.00e+0 | 12 | |
| Generative Quality Evaluation | Generative Quality Evaluation Prompts | CLIP Score27.09 | 11 | |
| Concept Erasure | Adversarial Prompts (Ring-A-Bell) | Success Rate (Sexually)2.5 | 11 | |
| Multi-concept Joint Erasure | Multi-sensitive concepts Cyberpunk + Nude | Concept Ratio5.5 | 2 | |
| Multi-concept Joint Erasure | Multi-sensitive concepts Political Elements + Nude | Concept Ratio6 | 2 | |
| Multi-concept Joint Erasure | Multi-sensitive concepts Nude + Cat | Concept Ratio4 | 2 | |
| Multi-concept Joint Erasure | Multi-sensitive concepts Nude + Gun | Concept Ratio5 | 2 |