Share your thoughts, 1 month free Claude Pro on usSee more

Response Classification on BeaverTails V Text-Image Response

84.8F1 Score

Qwen3Guard-8B-Gen

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3Guard-8B-Gen 2026.02		84.8
Qwen3Guard-4B-Stream 2026.02		84.6
Qwen3Guard-4B-Gen 2026.02		84.5
Qwen3Guard-8B-Stream 2026.02		84.2
Kelp 2026.02		84.1
GuardReasoner-8B 2025.12		84.02
Qwen3Guard-0.6B-Gen 2026.02		84
SCM-7B 2026.02		83.4
ProGuard-7B 2025.12		83.1
WildGuard-7B 2026.02		82.9
Qwen3Guard-0.6B-Stream 2026.02		82.7
GuardReasonerVL-7B 2025.12		82.35
DynaGuard-8B 2025.12		81.73
NExT-Guard 2026.02		81.2
MD-Judge-7B 2025.12		81.13
Gemini2.5-Flash 2025.12		80.72
NExT-Guard* 2026.02		80.6
ProGuard-7B 2025.12		80.44
ProGuard-3B 2025.12		79.83
ProGuard-3B 2025.12		79.19
Gemini2.5-Flash 2025.12		77.85
NemoGuard-8B 2026.02		77.4
LlamaGuard2-8B 2025.12		74.62
LlamaGuard4-12B 2025.12		73.51
WildGuard-7B 2025.12		73.39
GPT4o-mini 2025.12		72.92
GPT-OSS-SafeGuard-20B 2025.12		72.59
LlamaGuard3-8B 2025.12		72.4
LlamaGuard3-11B-Vision 2025.12		70.91
LlamaGuard-7B 2025.12		69.49
LlamaGuard4-12B 2026.02		67.5
LlamaGuard3-8B 2026.02		67.3
ShieldGemma-27B 2026.02		66.8
LlamaGuard3-11B-Vision 2025.12		66.62
GuardReasonerVL-7B 2025.12		66.13
GPT4o-mini 2025.12		63.5
LlamaGuard4-12B 2025.12		62.8
ShieldGemma-9B 2026.02		61.1
ShieldGemma-9B 2025.12		57