OlympiadBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | OlympiadBench Math | Accuracy99.86 | 84 | |
| Mathematical Reasoning | OlympiadBench Math (test) | Accuracy35.9 | 59 | |
| Math Reasoning | OlympiadBench | Accuracy90.7 | 54 | |
| Mathematical Reasoning | OlympiadBench | Accuracy65.81 | 48 | |
| Mathematical Reasoning | OlympiadBench | Pass@162.1 | 39 | |
| Mathematical Reasoning | OlympiadBench | Pass Rate60.67 | 36 | |
| Mathematical Reasoning | OlympiadBench | Accuracy0.7659 | 34 | |
| Mathematical Reasoning | OlympiadBench | Accuracy65.3 | 30 | |
| Mathematical Reasoning | OlympiadBench | EM14.7 | 30 | |
| Mathematical Reasoning | OlympiadBench | Accuracy0.44 | 24 | |
| Mathematical Reasoning | OlympiadBench | Avg Success Rate @844.25 | 23 | |
| Math Reasoning | OlympiadBench | Accuracy70.3 | 22 | |
| Math Reasoning | OlympiadBench | Pass@1 Accuracy48.2 | 19 | |
| Mathematical Reasoning | OlympiadBench Math | Pass@127 | 18 | |
| Mathematical Reasoning | OlympiadBench | Accuracy (Pass@1)73.3 | 17 | |
| Mathematical Reasoning | OlympiadBench | Pass@1673.6 | 16 | |
| Mathematical Reasoning | OlympiadBench (OLY.) | Pass@138.2 | 16 | |
| Mathematical Reasoning | Olympiadbench | Average@1660.6 | 15 | |
| Scientific Reasoning | OlympiadBench Physics | Accuracy87.3 | 14 | |
| Process-level verification | OlympiadBench ProcessBench (test) | Error8.2 | 13 | |
| Mathematical Reasoning | OlympiadBench | Pass@145.2 | 12 | |
| Mathematical Reasoning | OlympiadBench | Avg@1650.7 | 12 | |
| Mathematical Reasoning | OlympiadBench | Avg@336 | 12 | |
| Mathematical Reasoning | OlympiadBench OE_TO_maths_en_COMP | Accuracy74.04 | 12 | |
| Mathematical Reasoning | OlympiadBench | Pass@164 | 12 |
Showing 25 of 43 rows