Reasoning Hijacking: Subverting LLM Classification via Decision-Criteria Injection
About
Current LLM safety research predominantly focuses on mitigating Goal Hijacking, preventing attackers from redirecting a model's high-level objective (e.g., from "summarizing emails" to "phishing users"). In this paper, we argue that this perspective is incomplete and highlight a critical vulnerability in Reasoning Alignment. We propose a new adversarial paradigm: Reasoning Hijacking and instantiate it with Criteria Attack, which subverts model judgments by injecting spurious decision criteria without altering the high-level task goal. Unlike Goal Hijacking, which attempts to override the system prompt, Reasoning Hijacking accepts the high-level goal but manipulates the model's decision-making logic by injecting spurious reasoning shortcut. Though extensive experiments on three different tasks (toxic comment, negative review, and spam detection), we demonstrate that even newest models are prone to prioritize injected heuristic shortcuts over rigorous semantic analysis. The results are consistent over different backbones. Crucially, because the model's "intent" remains aligned with the user's instructions, these attacks can bypass defenses designed to detect goal deviation (e.g., SecAlign, StruQ), exposing a fundamental blind spot in the current safety landscape. Data and code are available at https://github.com/Yuan-Hou/criteria_attack
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Negative Review Detection | Negative Review | ASR56.1 | 14 | |
| Toxic Comment Detection | Toxic Comment | ASR47.3 | 14 | |
| Spam Email Detection | Spam Email | ASR58.9 | 14 | |
| Prompt Injection | Toxic Comment | ASR (None)89.9 | 10 | |
| Spam Email Detection | Spam Email | Token Count201 | 10 | |
| Toxic Comment Classification | Toxic Comment | Average Tokens201 | 10 | |
| Prompt Injection | Spam Email | ASR (None Defense)59.2 | 10 | |
| Negative Review Classification | Negative Review | Tokens Used54.7 | 10 | |
| Prompt Injection | Negative Review | ASR (None Defense)35.3 | 10 |