Share your thoughts, 1 month free Claude Pro on usSee more

Content Moderation on OpenAI Content Moderation

83.1Average F1 Score

DPR

Updated 12d ago

Evaluation Results

Method	Links
DPR 2026.04		83.1	94.9	81.1	78.4	75.2	86
ShieldGemma-9B 2026.04		82.1	-	-	-	-	-
Qwen3Guard-8B-Gen-loose 2026.04		81.3	-	-	-	-	-
Qwen3Guard-Stream-4B-loose 2026.04		81.2	-	-	-	-	-
Seed Information 2026.04		81	93.9	81.7	78.2	67	84.2
NemoGuard-8B 2026.04		81	-	-	-	-	-
Qwen3Guard-4B-Gen-loose 2026.04		80.7	-	-	-	-	-
ShieldGemma-27B 2026.04		80.5	-	-	-	-	-
Qwen3Guard-Stream-8B-loose 2026.04		80.3	-	-	-	-	-
OAI DR 2026.04		80	91.9	76.5	76.3	78.1	77.3
LlamaGuard3-8B 2026.04		79.5	-	-	-	-	-
DPR 2026.04		79.2	91	81.3	71.7	68.3	83.5
OAI DR 2026.04		77.6	82.8	80	73.8	68.3	82.9
Qwen3Guard-0.6B-Gen-loose 2026.04		77.6	-	-	-	-	-
Qwen3Guard-Stream-0.6B-loose 2026.04		76	-	-	-	-	-
Seed Information 2026.04		75.2	91.6	75.7	65.8	64	78.8
Llama3-StreamGuard-8B 2026.04		75	-	-	-	-	-
Llama3-StreamGuard-3B 2026.04		74.4	-	-	-	-	-
In-Context Learning 2026.04		74.1	92.7	80.3	64.5	55.1	77.9
PolyGuard-Qwen-7B 2026.04		74.1	-	-	-	-	-
Qwen3Guard-Stream-8B-strict 2026.04		74	-	-	-	-	-
LlamaGuard4-12B 2026.04		73.5	-	-	-	-	-
WildGuard-7B 2026.04		72.1	-	-	-	-	-
Llama3-StreamGuard-1B 2026.04		71.5	-	-	-	-	-
In-Context Learning 2026.04		70.7	92.3	72.8	58.2	61	69.1
Qwen3Guard-Stream-4B-strict 2026.04		70	-	-	-	-	-
Qwen3Guard-8B-Gen-strict 2026.04		68.8	-	-	-	-	-
Qwen3Guard-4B-Gen-strict 2026.04		68.3	-	-	-	-	-
Qwen3Guard-Stream-0.6B-strict 2026.04		68.3	-	-	-	-	-
Qwen3Guard-0.6B-Gen-strict 2026.04		66.5	-	-	-	-	-