| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Olympiad Bench | Accuracy73.5 | 123 | |
| Mathematical Reasoning | Olympiad Bench | Pass@1 Accuracy68.13 | 115 | |
| Mathematical Reasoning | Olympiad Bench | Accuracy85.2 | 73 | |
| Mathematical Reasoning | Olympiad Bench (test) | Pass@1 Accuracy83.53 | 24 | |
| Mathematical Reasoning | Olympiad Bench | Pass@848.5 | 22 | |
| Mathematical Reasoning | Olympiad bench | Pass@1 Accuracy (@16)57.2 | 17 | |
| Mathematical Reasoning | Olympiad-Bench | Avg@3258 | 14 | |
| Math and Text Reasoning | Olympiad Bench | PAQ73.67 | 14 | |
| Mathematical Reasoning | Olympiad-Bench | Pass@151.94 | 12 | |
| Mathematical Reasoning | Olympiad Bench | Pass@136.1 | 10 | |
| Mathematical Problem Solving | Olympiad Bench | Pass@8 Accuracy49.1 | 10 | |
| Mathematical Problem Solving | Olympiad Bench | Pass@1 Accuracy70.36 | 6 | |
| Tool-Integrated Reasoning | Olympiad Bench | Test Accuracy52.75 | 6 | |
| Mathematical Reasoning | Olympiad Bench | Pass@3269.04 | 6 | |
| Math Reasoning | Olympiad Bench | Avg@3241.25 | 6 | |
| Mathematical Reasoning | Olympiad-Bench | Accuracy Pass@130.4 | 5 | |
| Mathematical Reasoning | Olympiad Bench | Accuracy29.8 | 4 | |
| Reasoning | Olympiad Bench | Accuracy30.7 | 2 |