HMMT25
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | HMMT25 | Accuracy86.7 | 119 | |
| Mathematical Reasoning | HMMT25 | Accuracy (%)92.5 | 115 | |
| Mathematical Reasoning | HMMT25 | Avg@3217.9 | 34 | |
| Mathematical Reasoning | HMMT25 | Pass@1653.3 | 24 | |
| Mathematical Reasoning | HMMT25 | Avg@12 Accuracy48.1 | 21 | |
| Mathematical Reasoning | HMMT25 | Accuracy (HMMT25)16.3 | 21 | |
| Math Reasoning | HMMT25 | Accuracy (HMMT25)34.9 | 21 | |
| Mathematical Reasoning | HMMT25 | Mean Score (8 samples)13.33 | 18 | |
| Mathematical Reasoning | HMMT25 | Accuracy33.6 | 16 | |
| Math Reasoning | HMMT25 | Pass@866.7 | 14 | |
| Math | HMMT25 | Avg@1644.5 | 12 | |
| Mathematical Reasoning | HMMT25 | Average Score46.4 | 12 | |
| Long-chain Mathematical Reasoning | HMMT25 | Accuracy avg@3282.2 | 6 | |
| Mathematics | HMMT25 | Throughput (Req/s)16.83 | 6 | |
| Mathematical Reasoning | HMMT25 | Pass@853.33 | 5 | |
| Math reasoning | HMMT25 Nov. | Mean@815.83 | 4 |
Showing 16 of 16 rows