Olympiad
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Olympiad | Accuracy70.9 | 137 | |
| Mathematical Reasoning | Olympiad | Accuracy46.1 | 136 | |
| Mathematical Reasoning | Olympiad | Accuracy73.2 | 90 | |
| Mathematical Reasoning | Olympiad | Pass@1 Accuracy68.3 | 73 | |
| Mathematical Reasoning | Olympiad | Pass@1 Accuracy60.5 | 60 | |
| Mathematical Reasoning | Olympiad | Pass@169.8 | 50 | |
| Mathematical Reasoning | Olympiad | Avg@16 Accuracy70.7 | 47 | |
| Mathematical Reasoning | Olympiad | Pass@165.2 | 41 | |
| Math Reasoning | Olympiad | Average Rate @1665.6 | 38 | |
| Math Reasoning | Olympiad | Pass@168.6 | 30 | |
| Mathematical Reasoning | Olympiad (test) | Accuracy52.1 | 27 | |
| Mathematical Reasoning | Olympiad | Performance (%)50 | 26 | |
| Mathematical Problem Solving | Olympiad | Pass@k47.1 | 24 | |
| Mathematical Reasoning | Olympiad | Pass@k49.6 | 24 | |
| Mathematical Reasoning | Olympiad | Avg@k46.78 | 24 | |
| Math Reasoning | Olympiad | Accuracy68.55 | 24 | |
| Mathematical Reasoning | Olympiad | Accuracy (%)61.2 | 21 | |
| Mathematical Reasoning | Olympiad | P@140.86 | 20 | |
| Mathematical Reasoning | Olympiad | Avg@455.8 | 20 | |
| Competition Mathematics | Olympiad | Pass@154.89 | 20 | |
| Mathematical Reasoning | Olympiad | Pass@152.3 | 20 | |
| Mathematical Reasoning | Olympiad | Pass@154.4 | 19 | |
| Mathematical Reasoning | OLYMPIAD | Pass@1 Score42.2 | 18 | |
| Mathematical Reasoning | Olympiad | Pass@131.6 | 18 | |
| Mathematical Reasoning | Olympiad | Pass@142.4 | 18 |
Showing 25 of 68 rows