Share your thoughts, 1 month free Claude Pro on usSee more

Over-Refusal Evaluation on OverBench

5.59ORR

w/o Safety-Aligned Optimization

Updated 1mo ago

Evaluation Results

Method	Links
w/o Safety-Aligned Optimization 2026.06		5.59
FreoStream 2026.06		6.64
Qwen-Stream-8B 2026.06		10.16
YuFeng-XGuard-0.6B Prompt+Response 2026.06		12.69
GuardReasoner-1B 2026.06		14.5
Qwen-Gen-0.6B Prompt Only 2026.06		15.86
Qwen-Gen-0.6B Prompt+Response 2026.06		16.28
YuFeng-XGuard-0.6B Prompt Only 2026.06		26.17
Nemotron-4B 2026.06		29.2
w/o Future-Aware Reasoning 2026.06		30.99
Qwen-Stream-0.6B 2026.06		31.38