Math Benchmarks
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Math Benchmarks GSM8K, Minerva, MATH, MathQA | GSM8K Score59.24 | 53 | |
| Mathematical Reasoning | Math Benchmarks Aggregate | Pass@171.8 | 44 | |
| Mathematical Reasoning | Math Benchmarks Aggregate | Accuracy (Avg)81.9 | 40 | |
| Mathematical Reasoning | Math Benchmarks Average | Accuracy (ACC)76.1 | 35 | |
| Math Reasoning | Mean of six math benchmarks | Pass@143.8 | 12 | |
| Mathematical Reasoning | Math Benchmarks Overall (test) | Pass@187 | 12 | |
| Math Problem Solving | Math Benchmarks LIMO curation (test) | Accuracy72.6 | 10 | |
| Math Reasoning | Math Benchmarks MATH, GSM8K, AMC23, AIME24, Minerva, Gaokao, Olympiad (test) | MATH Score75.1 | 10 | |
| Mathematical Reasoning | Math Benchmarks (GSM8K, MATH, AMC23, AIME24) (test) | Accuracy (GSM8K)96 | 8 | |
| Mathematical Reasoning | Math Benchmarks (test) | GSM8K Accuracy28.9 | 3 |
Showing 10 of 10 rows