Olympiad
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Olympiad | Accuracy70.9 | 137 | |
| Mathematical Reasoning | Olympiad | Accuracy73.2 | 90 | |
| Mathematical Reasoning | Olympiad | Accuracy46.1 | 68 | |
| Mathematical Reasoning | Olympiad | Pass@169.8 | 50 | |
| Mathematical Reasoning | Olympiad | Pass@1 Accuracy65.73 | 30 | |
| Math Reasoning | Olympiad | Pass@168.6 | 30 | |
| Mathematical Reasoning | Olympiad (test) | Accuracy52.1 | 27 | |
| Mathematical Reasoning | Olympiad | Accuracy (%)61.2 | 21 | |
| Competition Mathematics | Olympiad | Pass@154.89 | 20 | |
| Mathematical Reasoning | Olympiad | Pass@152.3 | 20 | |
| Mathematical Reasoning | Olympiad | Pass@154.4 | 19 | |
| Mathematical Reasoning | Olympiad | Pass@131.6 | 18 | |
| Mathematical Reasoning | Olympiad | Pass@142.4 | 18 | |
| Mathematical Reasoning | Olympiad | Score83.4 | 17 | |
| Mathematical Reasoning | Olympiad | Pass@165.2 | 16 | |
| Mathematical Reasoning | Olympiad | Pass@1 Accuracy60.5 | 16 | |
| Mathematical Reasoning | Olympiad | Pass@140.65 | 16 | |
| Mathematical Reasoning | Olympiad | Pass@1690.95 | 16 | |
| Advanced Reasoning | Olympiad | Accuracy69 | 15 | |
| Mathematical Reasoning | Olympiad | Accuracy (@avg1)0.457 | 15 | |
| math Q&A | Olympiad | Accuracy30.4 | 14 | |
| Math Reasoning | Olympiad | Average Rate @1654.06 | 14 | |
| Mathematical Reasoning | Olympiad | Avg@16 Score54.5 | 13 | |
| Mathematical Reasoning | Olympiad | Acc@1640.5 | 12 | |
| Mathematical Reasoning | Olympiad | Average@3249.7 | 10 |
Showing 25 of 38 rows