Share your thoughts, 1 month free Claude Pro on usSee more

Safety Evaluation on XSTest

98.4Safety Score

Base

Updated 1mo ago

Evaluation Results

Method	Links
Base 2025.09		98.4
Qwen2.5 Instruct (72B) 2025.01		97.9
GPT-4o (2024-05-13) 2025.01		97.3
DeepSeek-V3 2025.01		97.1
o1 (2024-12-17) 2025.01		97
Claude-3.7-Sonnet 2025.01		96.4
DeepSeek-R1 2025.01		95.3
DeepSeek-R1 2025.01		94.4
IQuest-Coder-V1-40B-Thinking 2026.03		94.3
Qwen2.5-Coder-32B-Instruct 2026.03		90.6
Qwen3-Coder-480B-A35B-Instruct 2026.03		90.1
IQuest-Coder-V1-40B-Instruct 2026.03		89.3
Self-Improving Pretraining 2026.01		88.4
TARS 2025.09		88.3
Llama Pretrain Baseline 2026.01		87.6
GRPO 2025.09		86.8
Llama Base 2026.01		85.2
BackTrack 2025.09		80
IPO 2025.09		80
STAR 2025.09		76.9
Self-Improving Pretraining 2026.01		49
Llama Base 2026.01		39.5
Llama Pretrain Baseline 2026.01		35