Mathematical Reasoning on MATH 500 (Accuracy Variance, Consistency, Token Variance)
79.7Mean Accuracy
Gemma-3-12B-Instruct
Updated 3mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.12 | 79.7 | 0.0016 | 55.4 | 144,471.24 | |
2025.12 | 68.6 | 0.007 | 35.4 | 122,866.7 | |
2025.12 | 67 | 0.002 | 49.5 | 153,144.84 | |
2025.12 | 58.5 | 0.007 | 35.4 | 305,133.92 | |
2025.12 | 28.5 | 0.026 | 1.1 | 1,547,849 | |
2025.12 | 24.9 | 0.015 | 2.7 | 1,512,173.79 |