Share your thoughts, 1 month free Claude Pro on usSee more

General Capability on MMLU

79.6MMLU Accuracy

Original Weight Model

Updated 1mo ago

Evaluation Results

Method	Links
Original Weight Model 2025.04		79.6
REPBEND 2025.04		78.89
QWEN 3 14B 2025.10		76.1
ELS 2025.10		76.1
Surgical 2025.10		74.7
AdaSteer 2025.10		74.4
CAST 2025.10		74
AlphaSteer 2025.10		73.3
QWEN 3 8B 2025.10		72.8
ELS 2025.10		72.8
AlphaSteer 2025.10		72.3
Surgical 2025.10		71.2
AdaSteer 2025.10		70.9
CAST 2025.10		70.5
system prompt 2025.10		70.2
system prompt 2025.10		69.8
LLAMA3.1-8B-INST 2025.10		68.1
ELS 2025.10		68.1
Llama-3.1-8B-IT 2025.10		68
ELS 2025.10		68
Surgical 2025.10		67.7
CAST 2025.10		67.3
AlphaSteer 2025.10		66.7
WHP (W/O safe set) 2025.04		66.44
NPO (W/O safe set) 2025.04		66.29
WHP 2025.04		66.16
NPO 2025.04		66.13
TA 2025.04		66.09
SFT 2025.04		66.01
AdaSteer 2025.10		66
Original 2025.04		65.89
CB* 2025.04		65.77
CB 2025.04		65.77
DPO 2025.04		65.31
REPBEND 2025.04		65.08
Safety Prompting 2025.04		64.41
SFT 2025.10		63.4
Self-Play 2025.10		62.4
Defender-Only + SFT 2025.10		62.3
Self-Play + SFT 2025.10		62.3
Defender-Only 2025.10		62.2
system prompt 2025.10		62
Original 2025.04		60.18
WHP (W/O safe set) 2025.04		60.08
CB* 2025.04		60.08
CB 2025.04		59.93
NPO 2025.04		59.61
REPBEND 2025.04		59.48
R2D2* 2025.04		59.44
Safety Prompting 2025.04		59.26
WHP 2025.04		59.24
DPO 2025.04		59.21
NPO (W/O safe set) 2025.04		59.12
TA 2025.04		58.57
SFT 2025.04		58.46
RMU 2025.04		58.23
REPBEND 2025.04		58.14
Original Weight Model 2025.04		57.98
QWEN 3 1.7B 2025.10		57.9
ELS 2025.10		57.9
AdaSteer 2025.10		57.4
Surgical 2025.10		57.2
CAST 2025.10		56.8
AlphaSteer 2025.10		56.8
RMU 2025.04		50.02
system prompt 2025.10		49.1
LLAMA2-7B-CHAT 2025.10		47.6
ELS 2025.10		47.6
system prompt 2025.10		47.5
Surgical 2025.10		47
AdaSteer 2025.10		46
AlphaSteer 2025.10		46
CAST 2025.10		45.6