Share your thoughts, 1 month free Claude Pro on usSee more

Safety Classification on XSTest

95.8F1 Score

Label and intent reward

Updated 17d ago

Evaluation Results

Method	Links
Label and intent reward 2026.06		95.8
YuFeng-XGuard-Reason-8B 2026.07		95.4
WildGuard 7B 2026.06		94.5
GPT-OSS-Safeguard 120B 2026.06		94.4
AprielGuard 2025.12		94
Human-intent on AIMS 2026.06		93.6
Stage1-SFT-v4 2026.07		93.6
Stage3-DPO 2026.07		92.9
GPT-5.4 2026.06		92
GuardReasoner 8B 2026.06		91.9
YuFeng-XGuard-Reason-0.6B 2026.07		91.8
GPT-OSS-120B 2026.06		91.1
Qwen3Guard 2025.12		91
AprielGuard 2025.12		91
IF-DPO 2026.06		90.9
Llama-3.1-8B 2026.06		90.8
Qwen3Guard-8B-Gen 2026.07		90.8
Llama-3.1-8B 2026.06		90.4
Label reward 2026.06		90.4
Gemma-3-12B 2026.06		90.2
Qwen3Guard 2025.12		90
gpt-oss-safeguard 2025.12		90
Qwen3Guard-4B-Gen 2026.07		89.9
Llama Guard 2 2025.12		89
Gemma-3-12B 2026.06		88.4
LE-DPO 2026.06		88.4
Llama Guard 3 2025.12		88
Stage1-SFT-v1 2026.07		87.4
Stage1-SFT-v0 2026.07		87.1
IBM Granite Guardian 3.3 2025.12		87
Stage2-SFT 2026.07		86.7
IBM Granite Guardian 3.3 2025.12		86
Claude Sonnet 4.6 2026.06		86
Stage1-SFT-v3 2026.07		86
Qwen3Guard-0.8B-Gen 2026.07		85.3
Nemotron Safety 4B 2026.06		85.1
IBM Granite Guardian 3.2 2025.12		85
Stage1-SFT-v2 2026.07		84.7
Llama Guard 4 2025.12		84
LlamaGuard 4 2026.06		83.6
IBM Granite Guardian 3.1 2025.12		83
ShieldGemma 27B 2026.06		82.3
ShieldGemma 2025.12		82
IBM Granite Guardian 3.2 2025.12		81
CREST-LARGE 2025.12		69.83
CREST-BASE 2025.12		67.04