Share your thoughts, 1 month free Claude Pro on usSee more

Over-Refusal Evaluation on FalseReject

9.12ORR

FreoStream

Updated 1mo ago

Evaluation Results

Method	Links
FreoStream 2026.06		9.12
w/o Safety-Aligned Optimization 2026.06		9.73
YuFeng-XGuard-0.6B Prompt+Response 2026.06		9.74
Qwen-Stream-8B 2026.06		10.83
Qwen-Gen-0.6B Prompt+Response 2026.06		14
YuFeng-XGuard-0.6B Prompt Only 2026.06		16.69
Qwen-Stream-0.6B 2026.06		17.64
w/o Future-Aware Reasoning 2026.06		18.49
Qwen-Gen-0.6B Prompt Only 2026.06		20.92
Nemotron-4B 2026.06		21.44
GuardReasoner-1B 2026.06		27.41