Share your thoughts, 1 month free Claude Pro on usSee more

Harmful Refusal on DAN

94.9ASR

Qwen2.5-3B-IT

Updated 18d ago

Evaluation Results

Method	Links
Qwen2.5-3B-IT 2026.05		94.9
Llama3.1-8B-IT-AB 2025.06		93.7
Qwen2.5-7B-IT 2026.05		89.7
SELF-REDTEAM 2026.05		88.5
Qwen2.5-14B-IT 2026.05		84.5
ABS 2026.05		75.6
SELF-REDTEAM 2026.05		72.6
ABS 2026.05		72.1
ABS 2026.05		70.6
SELF-REDTEAM 2026.05		66.1
Defender-Only 2025.10		54.2
Llama3.1-8B-IT 2025.06		54
Self-Play 2025.10		53.7
Llama-3.1-8B-IT 2025.10		53.3
Qwen2.5-3B-IT 2025.06		51.7
SFT 2025.10		46.8
Defender-Only + SFT 2025.10		45.2
Self-Play + SFT 2025.10		39.6
Llama3.1-8B-IT-AB + SELF-REDTEAM 2025.06		39.6
Qwen2.5-7B-IT 2025.06		39
ELS 2025.10		37.2
Qwen2.5-3B-IT + SELF-REDTEAM 2025.06		33
Llama3.1-8B-IT + SELF-REDTEAM 2025.06		23.9
Qwen2.5-7B-IT + SELF-REDTEAM 2025.06		22.2
Qwen2.5-14B-IT 2025.06		21.7
Qwen2.5-14B-IT + SELF-REDTEAM 2025.06		10.6