Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

When Attention Betrays: Erasing Backdoor Attacks in Robotic Policies by Reconstructing Visual Tokens

About

Downstream fine-tuning of vision-language-action (VLA) models enhances robotics, yet exposes the pipeline to backdoor risks. Attackers can pretrain VLAs on poisoned data to implant backdoors that remain stealthy but can trigger harmful behavior during inference. However, existing defenses either lack mechanistic insight into multimodal backdoors or impose prohibitive computational costs via full-model retraining. To this end, we uncover a deep-layer attention grabbing mechanism: backdoors redirect late-stage attention and form compact embedding clusters near the clean manifold. Leveraging this insight, we introduce Bera, a test-time backdoor erasure framework that detects tokens with anomalous attention via latent-space localization, masks suspicious regions using deep-layer cues, and reconstructs a trigger-free image to break the trigger-unsafe-action mapping while restoring correct behavior. Unlike prior defenses, Bera requires neither retraining of VLAs nor any changes to the training pipeline. Extensive experiments across multiple embodied platforms and tasks show that Bera effectively maintains nominal performance, significantly reduces attack success rates, and consistently restores benign behavior from backdoored outputs, thereby offering a robust and practical defense mechanism for securing robotic systems.

Xuetao Li, Pinhan Fu, Wenke Huang, Nengyuan Pan, Songhua Yang, Kaiyan Zhao, Guancheng Wan, Mengde Li, Jifeng Xuan, Miao Li• 2026

Related benchmarks

TaskDatasetResultRank
Robotic ManipulationExtracting Tissue 30 random repositioning trials (test)
Completion Rate76.67
16
Robotic ManipulationShaking Hand 30 random repositioning trials (test)
Completion Percentage90
16
Robotic ManipulationGrasping Fanta 30 random repositioning trials (test)
CP Success Rate90
16
Robotic ManipulationLifting Cube 30 random repositioning trials (test)
CP0.8667
16
Backdoor RecoveryVLA Robotic Manipulation Tasks (Fanta, Cube, Tissue, Hand) (test)
Backdoor Recovery Fanta83.33
7
Showing 5 of 5 rows

Other info

Follow for update