Over-refusal evaluation on MMMU (test)
37Math Score
Prompt-based
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.01 | 37 | 5 | 32.5 | |
2026.01 | 35.5 | 27 | 45 | |
2026.01 | 35 | 4.5 | 32 | |
2026.01 | 34.5 | 27.5 | 44 | |
2026.01 | 24.5 | 11.5 | 47.5 | |
2026.01 | 24 | 46.5 | 33 | |
2026.01 | 24 | 46.5 | 32.5 | |
2026.01 | 22 | 11 | 50 | |
2026.01 | 21.5 | 22 | 30 | |
2026.01 | 21 | 21 | 27.5 | |
2026.01 | 13 | 2 | 6 | |
2026.01 | 12.5 | 3.5 | 9.5 | |
2026.01 | 12 | 2 | 6.5 | |
2026.01 | 11.5 | 1.5 | 9.5 | |
2026.01 | 11.5 | 9.5 | 8.5 | |
2026.01 | 10.5 | 2.5 | 6 | |
2026.01 | 9.5 | 1.5 | 4 | |
2026.01 | 9 | 7 | 8.5 | |
2026.01 | 9 | 6 | 5 | |
2026.01 | 7.5 | 2.5 | 5 | |
2026.01 | 7 | 0 | 4 | |
2026.01 | 6 | 0 | 5 | |
2026.01 | 4.5 | 2.5 | 5.5 | |
2026.01 | 3.5 | 0 | 1.5 | |
2026.01 | 3 | 1.5 | 11.5 | |
2026.01 | 3 | 0.5 | 7 | |
2026.01 | 2 | 0 | 1 | |
2026.01 | 1.5 | 1.5 | 10.5 | |
2026.01 | 1.5 | 2 | 3 | |
2026.01 | 1.5 | 0 | 2.5 | |
2026.01 | 0.5 | 0 | 0 | |
2026.01 | 0 | 0.5 | 4 |