Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Jailbreaking the Matrix: Nullspace Steering for Controlled Model Subversion

About

Large language models remain vulnerable to jailbreak attacks -- inputs designed to bypass safety mechanisms and elicit harmful responses -- despite advances in alignment and instruction tuning. We propose Head-Masked Nullspace Steering (HMNS), a circuit-level intervention that (i) identifies attention heads most causally responsible for a model's default behavior, (ii) suppresses their write paths via targeted column masking, and (iii) injects a perturbation constrained to the orthogonal complement of the muted subspace. HMNS operates in a closed-loop detection-intervention cycle, re-identifying causal heads and reapplying interventions across multiple decoding attempts. Across multiple jailbreak benchmarks, strong safety defenses, and widely used language models, HMNS attains state-of-the-art attack success rates with fewer queries than prior methods. Ablations confirm that nullspace-constrained injection, residual norm scaling, and iterative re-identification are key to its effectiveness. To our knowledge, this is the first jailbreak method to leverage geometry-aware, interpretability-informed interventions, highlighting a new paradigm for controlled model steering and adversarial safety circumvention.

Vishal Pramanik, Maisha Maliha, Susmit Jha, Sumit Kumar Jha• 2026

Related benchmarks

TaskDatasetResultRank
Jailbreak AttackHarmBench--
487
JailbreakingAdvBench (test)
ASR (GPT-4o)99
27
JailbreakingHarmBench (test)
ASR (GPT-4o)97
27
JailbreakingJBB-Behaviors (test)
ASR (GPT-4o)99
27
JailbreakingStrongReject (test)
ASR (GPT-4o)96
27
JailbreakAdvBench
ASR (GPT-4o)99.1
12
JailbreakJBB-Behaviors
ASR (GPT-4o)99.2
12
JailbreakStrongREJECT
ASR (GPT-4o)96.1
12
Jailbreak attack success rateAdvBench LLaMA-2-7B-Chat
ASR (SMO, GPT-4o)40
5
Jailbreak attack success rateAdvBench Phi-3 Medium 14B Instruct
ASR (SMO, GPT-4o)41
5
Showing 10 of 13 rows

Other info

Follow for update