Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SAFEPATH: Preventing Harmful Reasoning in Chain-of-Thought via Early Alignment

About

Large Reasoning Models (LRMs) have become powerful tools for complex problem solving, but their structured reasoning pathways can lead to unsafe outputs when exposed to harmful prompts. Existing safety alignment methods reduce harmful outputs but can degrade reasoning depth, leading to significant trade-offs in complex, multi-step tasks, and remain vulnerable to sophisticated jailbreak attacks. To address this, we introduce SAFEPATH, a lightweight alignment method that fine-tunes LRMs to emit a short, 8-token Safety Primer at the start of their reasoning, in response to harmful prompts, while leaving the rest of the reasoning process unsupervised. Empirical results across multiple benchmarks indicate that SAFEPATH effectively reduces harmful outputs while maintaining reasoning performance. Specifically, SAFEPATH reduces harmful responses by up to 90.0% and blocks 83.3% of jailbreak attempts in the DeepSeek-R1-Distill-Llama-8B model, while requiring 295.9x less compute than Direct Refusal and 314.1x less than SafeChain. We further introduce a zero-shot variant that requires no fine-tuning. In addition, we provide a comprehensive analysis of how existing methods in LLMs generalize, or fail, when applied to reasoning-centric models, revealing critical gaps and new directions for safer AI.

Wonje Jeung, Sangyeon Yoon, Minsuk Kahng, Albert No• 2025

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningMATH 500
pass@190.62
153
Mathematical ReasoningMathVista
Accuracy60.86
97
Mathematical ReasoningAIME 2024
Pass@152.08
54
Safety EvaluationStrongREJECT
Attack Success Rate51.44
45
Over-refusalXSTest--
42
ReasoningReasoning Evaluation Suite AIME 2024, GSM8k, MATH 500, GPQA
AIME 2024 Score0.7458
32
Safety EvaluationSafety Evaluation Suite HarmBench, StrongReject, WildJailbreak, XSTest
HarmBench Score67.61
28
Inference LatencyJailBreakV
Latency (s)6.75
25
ReasoningGPQA
Pass@147.41
21
ReasoningGSM8K
Pass@189.71
21
Showing 10 of 13 rows

Other info

Follow for update