Olympiad
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Olympiad | Accuracy70.9 | 92 | |
| Mathematical Reasoning | Olympiad | Accuracy71.62 | 50 | |
| Mathematical Reasoning | Olympiad | Pass@169.8 | 50 | |
| Mathematical Reasoning | Olympiad | Accuracy (%)61.2 | 21 | |
| Mathematical Reasoning | Olympiad | Pass@154.4 | 19 | |
| Mathematical Reasoning | Olympiad | Pass@131.6 | 18 | |
| Mathematical Reasoning | Olympiad | Pass@142.4 | 18 | |
| Mathematical Reasoning | Olympiad | Score83.4 | 17 | |
| Mathematical Reasoning | Olympiad | Pass@140.65 | 16 | |
| Mathematical Reasoning | Olympiad | Pass@1690.95 | 16 | |
| Mathematical Reasoning | Olympiad | Accuracy (@avg1)0.457 | 15 | |
| Math Reasoning | Olympiad | Average Rate @1654.06 | 14 | |
| Mathematical Reasoning | Olympiad (test) | Accuracy52.1 | 14 | |
| Mathematical Reasoning | Olympiad | Acc@1640.5 | 12 | |
| Mathematical Reasoning | Olympiad | Pass@1 Accuracy67.5 | 9 | |
| Mathematical Reasoning | OLYMPIAD | mean@843.62 | 9 | |
| Mathematical Reasoning | Olympiad | Acc@1639.8 | 6 | |
| Mathematical Reasoning | Olympiad | Avg@32 Accuracy49.59 | 6 | |
| Mathematical Reasoning | Olympiad | Avg Rank1.45 | 5 | |
| Mathematical reasoning | Olympiad | Pass@1 Mean63.2 | 5 | |
| Mathematical Reasoning | Olympiad OpenR1-Math Harder Subset | Accuracy68.1 | 3 | |
| Mathematical Problem Solving | Olympiad | Avg@3245 | 2 | |
| Mathematical Reasoning | Olympiad | Pass@1 Accuracy- | 0 |
Showing 23 of 23 rows