Olympiad Bench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Olympiad Bench | Pass@1 Accuracy68.13 | 115 | |
| Mathematical Reasoning | Olympiad Bench | Accuracy69.3 | 23 | |
| Mathematical Reasoning | Olympiad Bench | Pass@848.5 | 22 | |
| Mathematical Reasoning | Olympiad bench | Pass@1 Accuracy (@16)57.2 | 17 | |
| Mathematical Reasoning | Olympiad-Bench | Avg@3258 | 14 | |
| Math and Text Reasoning | Olympiad Bench | PAQ73.67 | 14 | |
| Mathematical Reasoning | Olympiad-Bench | Pass@151.94 | 12 | |
| Mathematical Problem Solving | Olympiad Bench | Pass@8 Accuracy49.1 | 10 | |
| Mathematical Reasoning | Olympiad Bench (test) | Pass@1 Accuracy83.53 | 9 | |
| Mathematical Reasoning | Olympiad Bench | Pass@3269.04 | 6 | |
| Math Reasoning | Olympiad Bench | Avg@3241.25 | 6 | |
| Mathematical Reasoning | Olympiad Bench | Accuracy29.8 | 4 | |
| Reasoning | Olympiad Bench | Accuracy30.7 | 2 |
Showing 13 of 13 rows