Mathematical Reasoning on GSM8k (Throughput and Latency)
39.69Throughput (tokens/s)
PACER
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 39.69 | 2.17 | |
2026.02 | 35.08 | 1.92 | |
2026.02 | 34.86 | 1.91 | |
2026.02 | 33.82 | 1.85 | |
2026.02 | 31.07 | 1.88 | |
2026.02 | 29.36 | 1.78 | |
2026.02 | 29.09 | 1.76 | |
2026.02 | 28.8 | 1.74 | |
2026.02 | 23.25 | 1.27 | |
2026.02 | 22.22 | 1.34 | |
2026.02 | 19.07 | 2.08 | |
2026.02 | 18.25 | 1 | |
2026.02 | 17.81 | 1.94 | |
2026.02 | 16.51 | 1 | |
2026.02 | 14.02 | 1.53 | |
2026.02 | 12.66 | 1.38 | |
2026.02 | 12.07 | 1.31 | |
2026.02 | 9.19 | 1 |