Share your thoughts, 1 month free Claude Pro on usSee more

Harmful Refusal on HarmBench vani harm

1ASR

Qwen2.5-14B-IT + SELF-REDTEAM

Updated 18d ago

Evaluation Results

Method	Links
Qwen2.5-14B-IT + SELF-REDTEAM 2025.06		1
Qwen2.5-3B-IT + SELF-REDTEAM 2025.06		2
Qwen2.5-7B-IT + SELF-REDTEAM 2025.06		4.4
Llama3.1-8B-IT + SELF-REDTEAM 2025.06		4.4
Llama3.1-8B-IT-AB + SELF-REDTEAM 2025.06		4.8
Qwen2.5-14B-IT 2025.06		5.6
Qwen2.5-3B-IT 2025.06		7.2
Qwen2.5-7B-IT 2025.06		16.3
Llama3.1-8B-IT 2025.06		16.3
Llama3.1-8B-IT-AB 2025.06		74.7