Arithmetic Reasoning on Countdown (Accuracy)
63.1Accuracy
GRPO + coupled rhythm credit
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.10 | 63.1 | |
2025.10 | 60.4 | |
2025.10 | 59.9 | |
2025.10 | 57.7 | |
2025.10 | 55 | |
2025.10 | 52.6 | |
2026.05 | 33.6 | |
2025.09 | 27.5 | |
2025.09 | 26 | |
2026.05 | 25.6 | |
2026.05 | 25 | |
2026.05 | 23.4 | |
2025.09 | 23.2 | |
2026.05 | 22.3 | |
2025.09 | 21.7 | |
2026.05 | 21.1 | |
2025.09 | 0.281 | |
2025.09 | 0.218 | |
2025.09 | 0.213 | |
2025.09 | 0.211 | |
2025.09 | 0.207 | |
2025.09 | 0.188 | |
2025.09 | 0.182 | |
2025.09 | 0.173 | |
2025.09 | 0.17 |