Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Exposing Functional Fusion: A New Class of Strategic Backdoor in Dynamic Prompt Architectures

About

Existing ViT backdoor attacks based on backbone-overwriting full-tuning are computationally expensive and inflict performance degradation. This has forced adversaries towards the Visual Parameter-Efficient Fine-Tuning (PEFT) paradigm, dominated by adapter-based (e.g., LoRA) and prompt-based (e.g., VPT) approaches. While adapter security has seen initial study, the risks of the burgeoning prompt-based ecosystem remain critically unexplored. We fill this critical gap, exposing how the evolution of VPT towards dynamic and context-aware architectures can facilitate a far more dangerous and emergent threat. This vulnerability arises even though these dynamic modules unlock superior benign performance. We propose VIPER, an attack framework built on a lightweight, dynamic Visual Prompt Generator (VPG) that demonstrates this vulnerability. Critically, this dynamic architecture enables Functional Fusion: an emergent phenomenon where malicious logic and benign task utility are tightly fused into the same sparse, high-magnitude parameter core. This fusion creates a formidable ``hostage" dilemma, as pruning the attack necessarily destroys the benign performance. Comprehensive evaluations show VIPER effectively addresses the attacker's trilemma: VIPER not only achieves state-of-the-art performance on clean data, but also maintains near-100% ASR even under 90% VPG-module pruning (where LoRA attacks collapse), while adding only an imperceptible 0.06ms (1.16%) of inference latency. VIPER's results, driven by Functional Fusion, expose a new, paradigm-level risk in dynamic prompt architectures.

Zeyao Liu, Zhendong Zhao, Xiaojun Chen, Xin Zhao, Yuexin Xuan, Xiaoshuang Ji• 2026

Related benchmarks

TaskDatasetResultRank
Backdoor AttackCaltech-101
ASR100
22
Backdoor AttackImageNet-100
Attack Success Rate (ASR)100
19
Backdoor AttackOxfordPets
Accuracy (ACC)94.36
9
Backdoor AttackFood101
Accuracy89.95
9
Backdoor AttackDTD
ACC75.23
9
Backdoor AttackUCF101
Accuracy82.37
9
Showing 6 of 6 rows

Other info

Follow for update