Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Harmful prompt detection on OpenAI
Loading...
79.11
F1 Score
LlamaGuard3
64.0092
67.9296
71.85
75.7704
Feb 22, 2025
F1 Score
Updated 1d ago
Evaluation Results
Method
Method
Links
F1 Score
LlamaGuard3
Methodology=Guard Model
2025.02
79.11
GraniteGuardian-3-1-8B
Methodology=Guard Model
2025.02
77.63
ShieldGemma-9B
Methodology=Guard Model
2025.02
77.63
Aegis-Guard-D
Methodology=Guard Model
2025.02
76.44
Ayub & Majumdar
Backbone=Mistral-7B-In...
2025.02
75.69
Abdelnabi et al.
Backbone=OLMo2-7B-Inst...
2025.02
75.19
Ayub & Majumdar
Backbone=Qwen3-8B-Inst...
2025.02
74.56
MLPM
Backbone=OLMo2-7B-Inst...
2025.02
74.21
MLPM
Backbone=Llama-8B-Inst...
2025.02
72.85
MLPM
Backbone=Qwen3-8B-Inst...
2025.02
72.35
WildGuard
Methodology=Guard Model
2025.02
72.28
MLPM
Backbone=Mistral-7B-In...
2025.02
70.68
Abdelnabi et al.
Backbone=Qwen3-8B-Inst...
2025.02
68.45
Abdelnabi et al.
Backbone=Llama-8B-Inst...
2025.02
67.99
Ayub & Majumdar
Backbone=OLMo2-7B-Inst...
2025.02
66.95
Ayub & Majumdar
Backbone=Llama-8B-Inst...
2025.02
66.6
Abdelnabi et al.
Backbone=Mistral-7B-In...
2025.02
64.59
Feedback
Search any
task
Search any
task