FreoStream:Enhancing Stream Guardrails via Future-Aware Reasoning and Safety-Aligned Optimization
About
Stream guardrails enable token-level safety detection before full responses are generated. However, they often make overly conservative judgements and block those sensitive but safe tokens, which is known as over-refusal. Due to lack of full context, they also fail to detect implicitly harmful content from jailbreaking. To address these challenges, we propose FreoStream, a novel streaming guardrail framework. Specifically, FreoStream fine-tunes a LoRA module to perform Future-Aware Reasoning when the base guardrail detects unsafe tokens. The reasoning process follows a Future-Reason-Judge paradigm: predict the future, reason about the full context and give the final judgement. This design can effectively reduce over-refusal by incorporating the future information. Moreover, we introduce the Safety-Aligned Optimization module that extracts the safety-aligned component from the reasoning gradients to update the base guardrail model, thereby enhancing streaming safety detection. Extensive experiments on various safety benchmarks demonstrate that FreoStream achieves lower over-refusal rates and better jailbreak defense compared to existing streaming guardrails.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Jailbreak Defense | ReNeLLM | ASR10.1 | 53 | |
| Overrefusal evaluation | OrBench-H | RR50.42 | 32 | |
| Jailbreak Defense | EquaCode | ASR2.31 | 11 | |
| Jailbreak Defense | DeepInc | ASR10.24 | 11 | |
| Jailbreak Defense | Jailbreak Defense Evaluation ReNeLLM, EquaCode, DeepInc, WordGame | ASR (ReNeLLM)4.02 | 11 | |
| Over-refusal evaluation | FalseReject | ORR9.12 | 11 | |
| Over-refusal evaluation | MorBench | ORR1.47 | 11 | |
| Over-refusal evaluation | OverBench | ORR5.59 | 11 | |
| Over-refusal evaluation | Over-Refusal Evaluation OrBench-Hard-1k FalseReject MorBench OverBench | ORR (OrBench-Hard-1k)24.44 | 11 | |
| Jailbreak Defense | WordGame | ASR25.48 | 11 |