Mathematical Reasoning Benchmarks
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Mathematical Reasoning Benchmarks (GSM8K, MATH, AMC23, Olympiad, Minerva) (test) | GSM8K Accuracy94 | 32 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks (GSM8K, MATH500, AMC, Olympiad Bench, AIME) (test) | GSM8K Accuracy85.3 | 28 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks AIME24, MATH500, Olympiad, AMC, Minerva (test) | AIME24 Score33.3 | 22 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks AIME24, AIME25, HMMT25 2024/2025 (test) | Accuracy on AIME 202478.33 | 20 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks GSM8K, MATH500, ASDiv, SVAMP, AMC23 (test) | GSM8K Accuracy81.96 | 20 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks | Average Score88.1 | 20 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks (AddSub, AQuA, GSM8k, MultiArith, SingleEq, SVAMP) (test) | Accuracy (AddSub)96.96 | 18 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks (test) | Average Score53.72 | 16 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks Average | Pass@4 Score71.88 | 14 | |
| Mathematical Reasoning | Mathematical Reasoning benchmarks GSM8K, MATH 500, Minerva, College Math, Olymp., AIME 24, AIME 25 | GSM8K Accuracy96.84 | 12 | |
| Mathematical Reasoning | Mathematical Reasoning benchmarks GSM8K, AddSub, AQuA, MultiArith (test) | GSM8K Accuracy79.03 | 12 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks (AIME24, AIME25, MATH500, AMC23, GSM8K, Minerva) | AIME24 Accuracy15.42 | 9 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks Average | Accuracy78.1 | 9 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks (AIME, HMMT, MATH500, AMC, O-Bench) (test) | AIME 2024 Score34.2 | 6 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks AIME24, AMC23, MATH500 | AIME24 Score15 | 6 | |
| Mathematical Reasoning | Mathematical Reasoning benchmarks (GSM8K, SingleEq, SVAMP, MultiArith, AddSub, AQuA, MAWPS) out-of-domain (evaluation) | GSM8K Accuracy16.1 | 5 | |
| Mathematical Reasoning | Mathematical reasoning benchmarks | Forward Pass Time (s)0.32 | 4 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks (MATH, AIME25, AMC, MINERVA, KAOYAN, OLYMPIAD, CN_MATH24) | MATH Accuracy91.1 | 4 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks AIME24, Math500, Olympiad, AMC, Minerva | AIME24 Score15.6 | 3 | |
| Mathematical Reasoning | Mathematical Reasoning Benchmarks AIME 24, AIME 25, AMC, Minerva, MATH-500, Olympiad, Gaokao23 (test) | AIME 2024 Score43.3 | 3 |
Showing 20 of 20 rows