Share your thoughts, 1 month free Claude Pro on usSee more

Over-refusal on XSTest

0Overrefusal Rate

Initial

Updated 7d ago

Evaluation Results

Method
Initial 2026.01	0	-	-	-	-	-	-
SafePath 2026.01	0	-	-	-	-	-	-
Unaligned 2026.05	0	-	-	-	-	-	-
Standard DPO 2026.05	0	-	-	-	-	-	-
Sequential 2026.05	0	-	-	-	-	-	-
Sqrt-Competence 2026.05	0	-	-	-	-	-	-
Curri-DPO 2026.05	0	-	-	-	-	-	-
Unaligned 2026.05	0	-	-	-	-	-	-
Standard DPO 2026.05	0	-	-	-	-	-	-
Sequential 2026.05	0	-	-	-	-	-	-
Sqrt-Competence 2026.05	0	-	-	-	-	-	-
Curri-DPO 2026.05	0	-	-	-	-	-	-
Staged-Competence 2026.05	0	-	-	-	-	-	-
Unaligned 2026.05	0	-	-	-	-	-	-
GPT-4o 2025.02	0.4	-	-	-	-	-	-
Staged-Competence 2026.05	0.4	-	-	-	-	-	-
Standard DPO 2026.05	1.2	-	-	-	-	-	-
Sequential 2026.05	1.2	-	-	-	-	-	-
Curri-DPO 2026.05	1.2	-	-	-	-	-	-
Sqrt-Competence 2026.05	2.4	-	-	-	-	-	-
GPT-4o 2025.02	2.6	-	-	-	-	-	-
No Defense 2025.10	3	-	-	-	-	-	-
Staged-Competence 2026.05	3.6	-	-	-	-	-	-
o1 2025.02	3.9	-	-	-	-	-	-
sonnet-4-thinking 2025.10	4	-	-	-	-	-	-
Vanilla 2025.10	4	-	-	-	-	-	-
ECSO 2025.10	4.8	-	-	-	-	-	-
WildJailbreak 2025.10	5	-	-	-	-	-	-
ASCoT (open) 2025.10	5	-	-	-	-	-	-
No Defense 2025.10	5	-	-	-	-	-	-
WildJailbreak 2025.10	5	-	-	-	-	-	-
Claude 3.5 Sonnet 2025.02	5.2	-	-	-	-	-	-
ASTRA 2025.10	5.4	-	-	-	-	-	-
o1 2025.02	5.7	-	-	-	-	-	-
o4-mini 2025.10	6	-	-	-	-	-	-
ASCoT 2025.10	6	-	-	-	-	-	-
No Defense 2025.10	6	-	-	-	-	-	-
WildJailbreak 2025.10	6	-	-	-	-	-	-
ASCoT (open) 2025.10	6	-	-	-	-	-	-
PAP Trained 2025.10	6	-	-	-	-	-	-
Improved CoT 2025.05	6.7	-	-	-	-	-	-
CAT 2025.10	7	-	-	-	-	-	-
ASCoT (closed) 2025.10	7	-	-	-	-	-	-
ASCoT (open) 2025.10	7	-	-	-	-	-	-
MoRAS 2025.10	7.2	-	-	-	-	-	-
Improved CoT 2025.05	7.3	-	-	-	-	-	-
Claude 3.5 Sonnet 2025.02	7.4	-	-	-	-	-	-
GPT-3.5-turbo 2025.02	7.8	-	-	-	-	-	-
GPT-3.5-turbo 2025.02	7.8	-	-	-	-	-	-
Refusal Training 2025.10	9	-	-	-	-	-	-
Refusal Training 2025.10	9	-	-	-	-	-	-
Refusal Training 2025.10	10	-	-	-	-	-	-
ASCoT (closed) 2025.10	10	-	-	-	-	-	-
PAP Trained 2025.10	10	-	-	-	-	-	-
PAP Trained 2025.10	12	-	-	-	-	-	-
ASCoT (closed) 2025.10	12	-	-	-	-	-	-
STAR1-R1-Distill-32B 2025.05	12.4	-	-	-	-	-	-
ETA 2025.10	15.6	-	-	-	-	-	-
RealSafe-R1-32B 2025.05	16	-	-	-	-	-	-
CoCA 2025.10	24.8	-	-	-	-	-	-
LAT 2025.10	30	-	-	-	-	-	-
LAT* 2025.10	30	-	-	-	-	-	-
CAT 2025.10	32	-	-	-	-	-	-
LAT* 2025.10	34	-	-	-	-	-	-
STAR1-R1-Distill-7B 2025.05	34	-	-	-	-	-	-
RealSafe-R1-7B 2025.05	36	-	-	-	-	-	-
SafeChain 2026.01	40	-	-	-	-	-	-
SafePath 2026.01	40	-	-	-	-	-	-
SafeChain 2026.01	40	-	-	-	-	-	-
THINKSAFE 2026.01	40	-	-	-	-	-	-
Initial 2026.01	40	-	-	-	-	-	-
SafePath 2026.01	40	-	-	-	-	-	-
CAT* 2025.10	40	-	-	-	-	-	-
LAT 2025.10	44	-	-	-	-	-	-
FigStep 2025.10	46	-	-	-	-	-	-
CAT* 2025.10	47	-	-	-	-	-	-
CAT* 2025.10	49	-	-	-	-	-	-
AutoSteer 2025.10	62.4	-	-	-	-	-	-
DPO_Whisperer 2025.05	80.67	-	-	-	-	-	-
LAT 2025.10	86	-	-	-	-	-	-
Mixtral (SFT_OG) 2025.05	87.6	-	-	-	-	-	-
Mixtral (SFT_DB) 2025.05	91.84	-	-	-	-	-	-
SFT_DB 2025.05	91.84	-	-	-	-	-	-
Qwen (SFT_DB) 2025.05	93.6	-	-	-	-	-	-
Qwen (SFT_OG) 2025.05	98	-	-	-	-	-	-
LAT* 2025.10	98	-	-	-	-	-	-
CAT 2025.10	98	-	-	-	-	-	-
Mixtral (Base) 2025.05	98.8	-	-	-	-	-	-
Qwen (Base) 2025.05	99.2	-	-	-	-	-	-
STAR-1 2026.01	120	-	-	-	-	-	-
THINKSAFE 2026.01	120	-	-	-	-	-	-
Initial 2026.01	120	-	-	-	-	-	-
SafeChain 2026.01	160	-	-	-	-	-	-
THINKSAFE 2026.01	160	-	-	-	-	-	-
STAR-1 2026.01	240	-	-	-	-	-	-
SafeKey 2026.01	360	-	-	-	-	-	-
SafeKey 2026.01	720	-	-	-	-	-	-
SafeKey 2026.01	800	-	-	-	-	-	-
DirectRefusal 2026.01	840	-	-	-	-	-	-
STAR-1 2026.01	1,200	-	-	-	-	-	-

Showing 100 of 186 rows