Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FreoStream:Enhancing Stream Guardrails via Future-Aware Reasoning and Safety-Aligned Optimization

About

Stream guardrails enable token-level safety detection before full responses are generated. However, they often make overly conservative judgements and block those sensitive but safe tokens, which is known as over-refusal. Due to lack of full context, they also fail to detect implicitly harmful content from jailbreaking. To address these challenges, we propose FreoStream, a novel streaming guardrail framework. Specifically, FreoStream fine-tunes a LoRA module to perform Future-Aware Reasoning when the base guardrail detects unsafe tokens. The reasoning process follows a Future-Reason-Judge paradigm: predict the future, reason about the full context and give the final judgement. This design can effectively reduce over-refusal by incorporating the future information. Moreover, we introduce the Safety-Aligned Optimization module that extracts the safety-aligned component from the reasoning gradients to update the base guardrail model, thereby enhancing streaming safety detection. Extensive experiments on various safety benchmarks demonstrate that FreoStream achieves lower over-refusal rates and better jailbreak defense compared to existing streaming guardrails.

Jianwei Wang, Guoyang Shen, Yanhong Wu, Haoran Li, Hao Peng, Huiping Zhuang, Cen Chen, Ziqian Zeng• 2026

Related benchmarks

TaskDatasetResultRank
Jailbreak DefenseReNeLLM
ASR10.1
53
Overrefusal evaluationOrBench-H
RR50.42
32
Jailbreak DefenseEquaCode
ASR2.31
11
Jailbreak DefenseDeepInc
ASR10.24
11
Jailbreak DefenseJailbreak Defense Evaluation ReNeLLM, EquaCode, DeepInc, WordGame
ASR (ReNeLLM)4.02
11
Over-refusal evaluationFalseReject
ORR9.12
11
Over-refusal evaluationMorBench
ORR1.47
11
Over-refusal evaluationOverBench
ORR5.59
11
Over-refusal evaluationOver-Refusal Evaluation OrBench-Hard-1k FalseReject MorBench OverBench
ORR (OrBench-Hard-1k)24.44
11
Jailbreak DefenseWordGame
ASR25.48
11
Showing 10 of 10 rows

Other info

Follow for update