OlympiadBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | OlympiadBench | Accuracy82.44 | 213 | |
| Mathematical Reasoning | OlympiadBench | Accuracy68.8 | 134 | |
| Mathematical Reasoning | OlympiadBench Math | Accuracy99.86 | 97 | |
| Math Reasoning | OlympiadBench | Accuracy90.7 | 76 | |
| Mathematical Reasoning | OlympiadBench | Accuracy0.7659 | 72 | |
| Mathematical Reasoning | OlympiadBench Math (test) | Accuracy35.9 | 59 | |
| Mathematical Reasoning | OlympiadBench | Accuracy60.44 | 57 | |
| Mathematical Reasoning | OlympiadBench | Accuracy65.81 | 57 | |
| Multimodal Mathematical Reasoning | OlympiadBench | Accuracy68 | 56 | |
| Mathematics | OlympiadBench | Pass@1 Accuracy78.72 | 51 | |
| Math Problem Solving | OlympiadBench | Accuracy68.32 | 50 | |
| Math Reasoning | OlympiadBench | Accuracy70.3 | 44 | |
| Mathematical Reasoning | OlympiadBench (test) | Accuracy57.9 | 40 | |
| Mathematical Reasoning | OlympiadBench | Pass@162.1 | 39 | |
| Mathematical Reasoning | OlympiadBench | Pass@1 Accuracy68.1 | 38 | |
| Mathematical reasoning | OlympiadBench | Accuracy56.7 | 38 | |
| Mathematical Reasoning | OlympiadBench | EM Score37.86 | 36 | |
| Mathematical Reasoning | OlympiadBench | Pass Rate60.67 | 36 | |
| Mathematical Reasoning | OlympiadBench | EM57.9 | 36 | |
| Mathematical reasoning | OlympiadBench | Pass@162.8 | 33 | |
| Math | OlympiadBench | Score77.59 | 31 | |
| Mathematical Reasoning | OlympiadBench 675 | Accuracy56.85 | 28 | |
| Mathematical Reasoning | OlympiadBench | Accuracy (avg@4)73.78 | 26 | |
| Mathematical Reasoning | OlympiadBench | Accuracy64.6 | 24 | |
| Mathematical Reasoning | OlympiadBench | Average Score @1629.06 | 24 |
Showing 25 of 138 rows