| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Math Benchmarks Aggregate | Pass@171.8 | 44 | |
| Mathematical Reasoning | Math Benchmarks Aggregate | Accuracy (Avg)81.9 | 18 | |
| Mathematical Reasoning | Math Benchmarks Overall (test) | Pass@187 | 12 | |
| Math Reasoning | Math Benchmarks MATH, GSM8K, AMC23, AIME24, Minerva, Gaokao, Olympiad (test) | MATH Score75.1 | 10 | |
| Mathematical Reasoning | Math Benchmarks (GSM8K, MATH, AMC23, AIME24) (test) | Accuracy (GSM8K)96 | 8 | |
| Mathematical Reasoning | Math Benchmarks (test) | GSM8K Accuracy28.9 | 3 |