Our new X account is live! Follow @wizwand_team for updates

General Capability on MMLU

79.6MMLU Accuracy

Original Weight Model

Updated 4d ago

Evaluation Results

Method	Links
Original Weight Model 2025.04		79.6
REPBEND 2025.04		78.89
WHP (W/O safe set) 2025.04		66.44
NPO (W/O safe set) 2025.04		66.29
WHP 2025.04		66.16
NPO 2025.04		66.13
TA 2025.04		66.09
SFT 2025.04		66.01
Original 2025.04		65.89
CB* 2025.04		65.77
CB 2025.04		65.77
DPO 2025.04		65.31
REPBEND 2025.04		65.08
Safety Prompting 2025.04		64.41
Original 2025.04		60.18
WHP (W/O safe set) 2025.04		60.08
CB* 2025.04		60.08
CB 2025.04		59.93
NPO 2025.04		59.61
REPBEND 2025.04		59.48
R2D2* 2025.04		59.44
Safety Prompting 2025.04		59.26
WHP 2025.04		59.24
DPO 2025.04		59.21
NPO (W/O safe set) 2025.04		59.12
TA 2025.04		58.57
SFT 2025.04		58.46
RMU 2025.04		58.23
REPBEND 2025.04		58.14
Original Weight Model 2025.04		57.98
RMU 2025.04		50.02