Share your thoughts, 1 month free Claude Pro on usSee more

Harmful Refusal on WG (test)

0ASR

Qwen2.5-14B-IT + SELF-REDTEAM

Updated 18d ago

Evaluation Results

Method	Links
Qwen2.5-14B-IT + SELF-REDTEAM 2025.06		0
Qwen2.5-7B-IT + SELF-REDTEAM 2025.06		0.2
Llama3.1-8B-IT + SELF-REDTEAM 2025.06		0.3
Qwen2.5-3B-IT + SELF-REDTEAM 2025.06		0.5
Llama3.1-8B-IT-AB + SELF-REDTEAM 2025.06		1.9
Qwen2.5-3B-IT 2025.06		2.2
Qwen2.5-14B-IT 2025.06		2.2
Qwen2.5-7B-IT 2025.06		2.7
Llama3.1-8B-IT 2025.06		6.3
Qwen2.5-14B-IT + SELF-REDTEAM 2025.06		8
Llama3.1-8B-IT + SELF-REDTEAM 2025.06		9.4
SELF-REDTEAM 2026.05		11.6
ABS 2026.05		12.2
ABS 2026.05		13.1
Self-Play + SFT 2025.10		13.8
Llama3.1-8B-IT-AB + SELF-REDTEAM 2025.06		13.8
Qwen2.5-14B-IT 2026.05		14.6
ABS 2026.05		16.9
Qwen2.5-14B-IT 2025.06		16.9
Self-Play 2025.10		17.2
SELF-REDTEAM 2026.05		17.8
Qwen2.5-7B-IT + SELF-REDTEAM 2025.06		17.9
SFT 2025.10		18.3
ELS 2025.10		21.9
Llama-3.1-8B-IT 2025.10		22.3
SELF-REDTEAM 2026.05		23.4
Llama3.1-8B-IT 2025.06		23.7
Qwen2.5-3B-IT + SELF-REDTEAM 2025.06		24.5
Defender-Only + SFT 2025.10		25.1
Defender-Only 2025.10		27.6
Qwen2.5-7B-IT 2026.05		27.9
Qwen2.5-3B-IT 2026.05		28.2
Qwen2.5-7B-IT 2025.06		30.3
Qwen2.5-3B-IT 2025.06		36.5
Llama3.1-8B-IT-AB 2025.06		47.8
Llama3.1-8B-IT-AB 2025.06		55.3