Share your thoughts, 1 month free Claude Pro on usSee more

Response Harmfulness Detection on SafeRLHF

72.1F1 Score

BeaverDam

Updated 2d ago

Evaluation Results

Method	Links
BeaverDam 2026.05		72.1
COLAGUARD 2026.05		70.49
GuardReasoner 2026.05		70.04
GuardReasoner 2026.05		70.04
ConsisGuard 2026.05		69.98
ConsisGuard 2026.05		69.7
GuardReasoner 2026.05		69.02
GuardReasoner 2026.05		69.02
COLAGUARD 2026.05		68.72
GuardReasoner 2026.05		68.39
Claude 3.5+CoT 2026.05		67.54
o1-preview 2026.05		66.6
GPT-4o+CoT 2026.05		65.1
o1-pre+CoT 2026.05		65.1
MD-Judge 2026.05		64.7
MD-Judge 2026.05		64.7
qwen3-CoT 2026.05		64.42
GPT-4o+CoT 2026.05		64.34
WildGuard 2026.05		64.2
WildGuard 2026.05		64.2
GPT-4o 2026.05		64.05
Gemini 1.5+CoT 2026.05		63.73
QWQ+CoT 2026.05		63.71
QwQ-preview 2026.05		62.76
GPT-4+CoT 2026.05		61.25
HarmBench LLaMA 2026.05		60
Aegis Guard Defensive 2026.05		59.3
Aegis Guard Def 2026.05		59.3
Aegis Guard Permissive 2026.05		55.9
Aegis Guard Per 2026.05		55.9
HarmBench Mistral 2026.05		52.4
LLaMA Guard 2 2026.05		51.6
LLaMA Guard 2 2026.05		51.6
LLaMA Guard 2026.05		48.4
ShieldGemma 2026.05		47.07
ShieldGemma 2026.05		47.07
LLaMA Guard 3 2026.05		44.36
LLaMA Guard 3 2026.05		44.36
ShieldGemma 2026.05		16.92
ShieldGemma 2026.05		16.92
Moderation 2026.05		10.1