Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

AISA: Awakening Intrinsic Safety Awareness in Large Language Models against Jailbreak Attacks

About

Large language models (LLMs) remain vulnerable to jailbreak prompts that elicit harmful or policy-violating outputs, while many existing defenses rely on expensive fine-tuning, intrusive prompt rewriting, or external guardrails that add latency and can degrade helpfulness. We present AISA, a lightweight, single-pass defense that activates safety behaviors already latent inside the model rather than treating safety as an add-on. AISA first localizes intrinsic safety awareness via spatiotemporal analysis and shows that intent-discriminative signals are broadly encoded, with especially strong separability appearing in the scaled dot-product outputs of specific attention heads near the final structural tokens before generation. Using a compact set of automatically selected heads, AISA extracts an interpretable prompt-risk score with minimal overhead, achieving detector-level performance competitive with strong proprietary baselines on small (7B) models. AISA then performs logits-level steering: it modulates the decoding distribution in proportion to the inferred risk, ranging from normal generation for benign prompts to calibrated refusal for high-risk requests -- without changing model parameters, adding auxiliary modules, or requiring multi-pass inference. Extensive experiments spanning 13 datasets, 12 LLMs, and 14 baselines demonstrate that AISA improves robustness and transfer while preserving utility and reducing false refusals, enabling safer deployment even for weakly aligned or intentionally risky model variants.

Weiming Song, Xuan Xie, Ruiping Yin• 2026

Related benchmarks

TaskDatasetResultRank
Jailbreak Defense EvaluationXST
Strong-Reject Score1.455
21
Jailbreak Defense EvaluationSB
Strong-Reject Score (SR)1.558
21
Jailbreak Defense EvaluationL3J
Strong-Reject Score (SR)1.441
21
Jailbreak Defense EvaluationADVB
Strong-Reject Score (SR)1.11
21
Jailbreak Defense EvaluationHB
Strong-Reject Score (SR)1.23
21
Jailbreak Defense EvaluationALL-4
SR Score1.993
21
Jailbreak Defense EvaluationWGT
Strong-Reject Score (SR)1.726
21
Jailbreak DetectionXST
Accuracy95.11
13
Jailbreak DetectionWGT
Accuracy90.17
13
Jailbreak DetectionEJ-OO
Accuracy99.17
13
Showing 10 of 20 rows

Other info

Follow for update