Share your thoughts, 1 month free Claude Pro on usSee more

Text Query Safety on HarmBench

94.85F1 Score

SingGuard-8B

Updated 1mo ago

Evaluation Results

Method	Links
SingGuard-8B 2026.06		94.85
YuFeng-XGuard-Reason-8B 2026.06		94.66
SingGuard-4B 2026.06		94.66
SingGuard-2B 2026.06		94.2
GPT-5.1 2026.06		93.92
Qwen3Guard-8B 2026.06		93.26
WildGuard 2026.06		92.88
GuardReasoner-VL-7B 2026.06		92.11
GuardReasoner-VL-7B 2026.06		91.36
GraniteGuardian 2026.06		90.45
SingGuard-4B 2026.06		90.32
Qwen3-VL-235B 2026.06		90.18
SingGuard-2B 2026.06		90.14
Qwen3Guard-8B-strict 2026.06		89.07
SingGuard-8B 2026.06		88.92
Qwen3Guard-8B-loose 2026.06		88.16
YuFeng-XGuard-Reason-8B 2026.06		86.72
Llama Guard 3 2026.06		86.68
Gemini3-Pro 2026.06		86.15
Llama Guard 3 2026.06		85.44
Qwen3Guard-8B 2026.06		84.01
GPT-5.1 2026.06		78.12
Qwen3-VL-235B 2026.06		76.64
Gemini3-Pro 2026.06		76.32
WildGuard 2026.06		69.76
GraniteGuardian 2026.06		66.67
ShieldGemma-9B 2026.06		64.63
ShieldGemma-9B 2026.06		64.41