The Invitation Trap: Proactive Availability Backdoor in LLMs via Conversational Induction
About
Current backdoor attacks against LLMs are typically manipulated by the attacker and remain passive. In this paper, we introduce the \textbf{Proactive Availability Backdoor (PAB)}, a novel paradigm that shifts the attack vector from passive waiting to active social engineering. By weaponizing the inherent helpfulness of aligned LLMs, PAB proactively traps users into executing trigger-implanted queries by offering suggestions, achieving high aggressiveness, precision and stealthiness. To rigorously evaluate its threat in a real-life context, we introduce a dual-agent ecological simulation framework based on selected dimensions of the Five-Factor Model, and deploy PAB with few-shot prompts. Being validated on different models and domains, PAB performs remarkably and its effective attack success rate, which calculates the joint probability of attack incidence rate and attack success rate, goes to \textbf{73.1\%}. We also introduce \textbf{Anti-PAB}, a defense method tailored for PAB. Our findings reveal that the helpfulness of LLMs can be weaponized to compromise availability, exposing a serious hidden threat to LLMs users. We release all the scripts and datasets in the experiments at \texttt{https://anonymous.4open.science/r/PAB-ANONYMOUS/}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Backdoor Attack Evaluation | Legislative Drafting | ASR88 | 10 | |
| Backdoor Attack Evaluation | Software Engineering | ASR95 | 8 | |
| Backdoor Attack Evaluation | Healthcare Advice | AIR88 | 5 | |
| Backdoor Attack | Legislative Drafting Scenario | Average Turn3.03 | 5 | |
| Backdoor Attack | Healthcare Advice Scenario | Average Turn Count3.25 | 5 |