Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Harmful Fine-tuning Attack on BeaverTails
Loading...
64.5
Attack Success Rate (ASR)
SFT
6.572
21.611
36.65
51.689
Jun 29, 2026
Attack Success Rate (ASR)
Updated 25d ago
Evaluation Results
Method
Method
Links
Attack Success Rate (ASR)
SFT
Model=Gemma-2-9B-IT
2026.06
64.5
SFT
Model=Qwen2.5-7B-Instruct
2026.06
63.6
SFT
Model=Llama-2-7B-Chat
2026.06
62.5
Lisa
Model=Llama-2-7B-Chat
2026.06
61.4
Lisa
Model=Gemma-2-9B-IT
2026.06
60.8
Lisa
Model=Qwen2.5-7B-Instruct
2026.06
60.1
Constrained SFT
Model=Gemma-2-9B-IT
2026.06
47.7
Constrained SFT
Model=Qwen2.5-7B-Instruct
2026.06
46.4
Constrained SFT
Model=Llama-2-7B-Chat
2026.06
37.8
DR-SFT
Model=Qwen2.5-7B-Instruct
2026.06
17
DR-SFT
Model=Llama-2-7B-Chat
2026.06
14.3
DR-SFT
Model=Gemma-2-9B-IT
2026.06
8.8
Feedback
Search any
task
Search any
task