Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Backdoor Sentinel: Detecting and Detoxifying Backdoors in Diffusion Models via Temporal Noise Consistency

About

Diffusion models have been widely deployed in AIGC services; however, their reliance on opaque training data and procedures exposes a broad attack surface for backdoor injection. In practical auditing scenarios, due to the protection of intellectual property and commercial confidentiality, auditors are typically unable to access model parameters, rendering existing white-box or query-intensive detection methods impractical. More importantly, even after the backdoor is detected, existing detoxification approaches are often trapped in a dilemma between detoxification effectiveness and generation quality. In this work, we identify a previously unreported phenomenon called temporal noise unconsistency, where the noise predictions between adjacent diffusion timesteps is disrupted in specific temporal segments when the input is triggered, while remaining stable under clean inputs. Leveraging this finding, we propose Temporal Noise Consistency Defense (TNC-Defense), a unified framework for backdoor detection and detoxification. The framework first uses the adjacent timestep noise consistency to design a gray-box detection module, for identifying and locating anomalous diffusion timesteps. Furthermore, the framework uses the identified anomalous timesteps to construct a trigger-agnostic, timestep-aware detoxification module, which directly corrects the backdoor generation path. This effectively suppresses backdoor behavior while significantly reducing detoxification costs. We evaluate the proposed method under five representative backdoor attack scenarios and compare it with state-of-the-art defenses. The results show that TNC-Defense improves the average detection accuracy by $11\%$ with negligible additional overhead, and invalidates an average of $98.5\%$ of triggered samples with only a mild degradation in generation quality.

Bingzheng Wang, Xiaoyan Gu, Hongbo Xu, Hongcheng Li, Zimo Yu, Jiang Zhou, Weiping Wang• 2026

Related benchmarks

TaskDatasetResultRank
Backdoor DetoxificationMS-COCO BadT2I_tok
FID (Clean)46.26
6
Backdoor DetoxificationMS-COCO EvilEdit
FID (Clean)60.09
6
Backdoor DetoxificationMS-COCO PersonalBKD_dream
FID (Clean)36.01
6
Backdoor DetoxificationMS-COCO Average across attacks
FID (Clean)47.99
6
Backdoor DetoxificationMS-COCO BadT2I_sent
FID (Clean)49.63
6
Backdoor DetectionMS-COCO BadT2ITok v1.4 (test)
Accuracy93.8
5
Backdoor DetectionMS-COCO BadT2ISent v1.4 (test)
Accuracy91.2
5
Backdoor DetectionMS-COCO EvilEdit v1.4 (test)
Accuracy74.4
5
Backdoor DetectionMS-COCO VillanBKD v1.4 (test)
Accuracy96.2
5
Backdoor DetectionMS-COCO PersonalBKDDream v1.4 (test)
Accuracy74.9
5
Showing 10 of 10 rows

Other info

Follow for update