Our new X account is live! Follow @wizwand_team for updates

Over-refusal on Wildjailbreak (Benign)

28.4Wildjailbreak Benign Refusal Rate

DPO

Updated 4d ago

Evaluation Results

Method	Links
DPO 2025.04		28.4	-
NPO 2025.04		43.2	71.65
NPO 2025.04		43.2	-
NPO (W/O safe set) 2025.04		50	-
CB 2025.04		52.4	75.87
CB* 2025.04		52.4	-
Safety Prompting 2025.04		65.6	-
NPO 2025.04		70	74.52
NPO 2025.04		70	-
RMU 2025.04		72.4	72.9
RMU 2025.04		72.4	-
NPO (W/O safe set) 2025.04		76	-
CB 2025.04		82	73.62
CB* 2025.04		82	-
WHP 2025.04		83.6	-
TA 2025.04		88.8	70.71
TA 2025.04		88.8	-
CB 2025.04		89.2	81.61
REPBEND 2025.04		89.2	83.14
CB 2025.04		89.2	-
REPBEND 2025.04		89.2	-
RMU 2025.04		90.4	71.85
RMU 2025.04		90.4	-
SFT 2025.04		90.8	-
Original Weight Model 2025.04		92	73.9
Original 2025.04		92	-
WHP (W/O safe set) 2025.04		92.4	-
REPBEND 2025.04		93.6	81.23
REPBEND 2025.04		93.6	-
R2D2 2025.04		96.8	72.67
SFT 2025.04		96.8	-
R2D2* 2025.04		96.8	-
TA 2025.04		97.6	72.96
CB 2025.04		97.6	77.34
TA 2025.04		97.6	-
CB 2025.04		97.6	-
WHP 2025.04		98.4	-
Safety Prompting 2025.04		98.8	-
DPO 2025.04		99.6	-
WHP (W/O safe set) 2025.04		99.6	-
Original Weight Model 2025.04		100	63.81
Original 2025.04		100	-
Original Weight Model 2025.04		-	98.8
REPBEND 2025.04		-	82.8
Original Weight Model 2025.04		-	100
REPBEND 2025.04		-	99.6