Share your thoughts, 1 month free Claude Pro on usSee more

Harmfulness Detection on OpenAI Moderation

92.9Macro F1 Score

SIREN

Updated 2d ago

Evaluation Results

Method	Links
SIREN 2026.04		92.9
SIREN 2026.04		92
SIREN 2026.04		91.3
SIREN 2026.04		91.2
LlamaGuard3 2026.04		85.3
Aegis Guard 2.0 2026.05		81
LLaMA Guard 3 2026.05		79.69
LLaMA Guard 3 2026.05		79.69
Moderation 2026.05		79
ShieldGemma 2026.05		78.58
ShieldGemma 2026.05		78.58
Qwen3Guard 2026.04		78.3
GPT-4o+CoT 2026.05		76.78
GPT-4o+CoT 2026.05		76.2
LLaMA Guard 2 2026.05		76.1
LLaMA Guard 2 2026.05		76.1
Qwen3Guard 2026.04		75.9
LLaMA Guard 2026.05		75.8
o1-pre+CoT 2026.05		75.24
Aegis Guard Permissive 2026.05		74.7
Aegis Guard Per 2026.05		74.7
o1-preview 2026.05		74.6
ConsisGuard 2026.05		74.35
COLAGUARD 2026.05		73.45
COLAGUARD 2026.05		73.15
ConsisGuard 2026.05		73.11
qwen3-CoT 2026.05		72.89
WildGuard 2026.05		72.1
WildGuard 2026.05		72.1
GuardReasoner 2026.05		72
GuardReasoner 2026.05		72
GuardReasoner 2026.05		71.87
GuardReasoner 2026.05		71.87
GuardReasoner 2026.05		70.06
LlamaGuard3 2026.04		67.5
Aegis Guard Defensive 2026.05		67.5
Aegis Guard Def 2026.05		67.5
QWQ+CoT 2026.05		65.34
GPT-4+CoT 2026.05		63.65
GPT-4o 2026.05		62.26
Gemini 1.5+CoT 2026.05		62.06
QwQ-preview 2026.05		61.58
Claude 3.5+CoT 2026.05		53.72
ShieldGemma 2026.05		13.89
ShieldGemma 2026.05		13.89