Mathematical Reasoning
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Mathematical Reasoning Aggregate | Average Score75.4 | 46 | |
| Mathematical Reasoning | Mathematical Reasoning Macro Average | Pass@16 (Avg)69 | 24 | |
| Mathematical Reasoning | Mathematical Reasoning In-Distribution various (test) | AIME 24 Score66.4 | 22 | |
| Mathematical Reasoning | Mathematical Reasoning Average | Pass@153.4 | 18 | |
| Offline OOD Detection | Mathematical Reasoning Far-shift OOD | AUROC96.54 | 14 | |
| Offline OOD Detection | Mathematical Reasoning Near-shift OOD | AUROC98.76 | 14 | |
| Mathematical Reasoning | Mathematical Reasoning AIME 24/25, AMC, MATH-500, Minerva, Olympiad | AIME 2024 Score34.2 | 13 | |
| Mathematical Reasoning | Mathematical Reasoning benchmarks (AIME2024, AMC, MATH-500, Minerva, Olympiad) | AIME 2024 Score33.5 | 12 | |
| Mathematical reasoning | Mathematical Reasoning (MATH500, AIME25, OlympiadBench, AMC23) 2023/2025 (test) | MATH Score86.2 | 12 | |
| OOD Quality Estimation | Mathematical Reasoning OOD (Near-shift) | Kendall Tau0.159 | 12 | |
| OOD Quality Estimation | Mathematical Reasoning Far-shift OOD | Kendall's Tau0.161 | 12 | |
| Mathematical Reasoning | Mathematical Reasoning Out-of-distribution | MMLU-Pro76.5 | 10 | |
| Mathematical Reasoning | Mathematical Reasoning Datasets | SFT Data Used128 | 9 | |
| Mathematical Reasoning | Mathematical Reasoning Aggregate | Average Accuracy (Pass@1)61.5 | 8 | |
| Mathematical Reasoning | Mathematical Reasoning (GSM8K, MATH, STEM, TABMWP) | GSM8K Accuracy77.6 | 6 | |
| Mathematical Reasoning | Mathematical Reasoning Average (AMC23, Minerva, Olympiad, Math500, AIME24, AIME25) | Acc@1638.9 | 6 | |
| Mathematical Reasoning | Mathematical Reasoning Held-out (test) | Accuracy48.92 | 5 | |
| Reasoning Robustness | Mathematical Reasoning Perturbation Experiments | Robustness Perturbation Success Rate (R-PSR)76.2 | 4 | |
| Reasoning | Mathematical Reasoning (train) | MTL (Loss)1,177.8 | 4 | |
| Mathematical Reasoning | Mathematical Reasoning (OOD) | Algebra222 Accuracy89.9 | 4 | |
| Mathematical Reasoning | Mathematical Reasoning (in-distribution) | GSM8K Score81.7 | 4 | |
| Mathematical Reasoning | Mathematical Reasoning Average | Mean@8 Accuracy38.66 | 3 | |
| Mathematical Reasoning | Mathematical Reasoning | CA47.19 | 2 | |
| Mathematical reasoning | Mathematical reasoning datasets | Metric- | 0 |
Showing 24 of 24 rows