Differential Vector Erasure: Unified Training-Free Concept Erasure for Flow Matching Models
About
Text-to-image diffusion models have demonstrated remarkable capabilities in generating high-quality images, yet their tendency to reproduce undesirable concepts, such as NSFW content, copyrighted styles, or specific objects, poses growing concerns for safe and controllable deployment. While existing concept erasure approaches primarily focus on DDPM-based diffusion models and rely on costly fine-tuning, the recent emergence of flow matching models introduces a fundamentally different generative paradigm for which prior methods are not directly applicable. In this paper, we propose Differential Vector Erasure (DVE), a training-free concept erasure method specifically designed for flow matching models. Our key insight is that semantic concepts are implicitly encoded in the directional structure of the velocity field governing the generative flow. Leveraging this observation, we construct a differential vector field that characterizes the directional discrepancy between a target concept and a carefully chosen anchor concept. During inference, DVE selectively removes concept-specific components by projecting the velocity field onto the differential direction, enabling precise concept suppression without affecting irrelevant semantics. Extensive experiments on FLUX demonstrate that DVE consistently outperforms existing baselines on a wide range of concept erasure tasks, including NSFW suppression, artistic style removal, and object erasure, while preserving image quality and diversity.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Concept Unlearning | UnlearnDiffAtk | -- | 36 | |
| Artistic Style Erasure | MSCOCO Concept-prune 480 | Top-1 Accuracy0.00e+0 | 15 | |
| NSFW Concept Erasure | I2P 4,703 potentially unsafe prompts | Total Success Count146 | 10 | |
| Concept Erasure | I2P | ASR (%)2.4 | 5 | |
| Multi-concept Erasure | MSCOCO 480 | UA (%)3.5 | 5 | |
| Object Erasure | MSCOCO 480 | CLIP Similarity30.43 | 5 | |
| Concept Erasure | MMA | ASR (%)7.1 | 5 | |
| Concept Erasure | Ring-A-Bell Ring16 | ASR5.3 | 5 | |
| Concept Erasure | Ring-A-Bell Ring38 | ASR15.8 | 5 | |
| Concept Erasure | Ring-A-Bell (Ring77) | ASR9.5 | 5 |