Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Over-refusal Mitigation on Gemma-2B Over-refusal
Loading...
1.6
Informative Refusal Rate
Original
-0.764
15.193
31.15
47.107
Jun 18, 2026
Informative Refusal Rate
Updated 1mo ago
Evaluation Results
Method
Method
Links
Informative Refusal Rate
Original
Inference Precision=FP32
2026.06
1.6
Original
Inference Precision=FP32
2026.06
2.4
Original
Inference Precision=FP32
2026.06
2.7
QVec
Inference Precision=LL...
2026.06
3.4
Gaussian
Inference Precision=FP4
2026.06
3.73
QVec
Inference Precision=NF4
2026.06
6.87
Gaussian
Inference Precision=NF4
2026.06
7.07
Gaussian
Inference Precision=LL...
2026.06
7.2
QVec
Inference Precision=FP4
2026.06
10.3
Attacked
Inference Precision=LL...
2026.06
25.9
Attacked
Inference Precision=NF4
2026.06
39.5
Attacked
Inference Precision=FP4
2026.06
60.7
Feedback
Search any
task
Search any
task
