| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | OlympiadBench | Accuracy82.44 | 213 | |
| Mathematical Reasoning | OlympiadBench Math | Accuracy99.86 | 84 | |
| Mathematical Reasoning | OlympiadBench | Accuracy65.3 | 82 | |
| Math Reasoning | OlympiadBench | Accuracy90.7 | 76 | |
| Mathematical Reasoning | OlympiadBench | Accuracy0.7659 | 72 | |
| Mathematical Reasoning | OlympiadBench Math (test) | Accuracy35.9 | 59 | |
| Mathematical Reasoning | OlympiadBench | Accuracy65.81 | 57 | |
| Multimodal Mathematical Reasoning | OlympiadBench | Accuracy68 | 56 | |
| Mathematics | OlympiadBench | Pass@1 Accuracy78.72 | 51 | |
| Math Reasoning | OlympiadBench | Accuracy70.3 | 44 | |
| Mathematical Reasoning | OlympiadBench (test) | Accuracy57.9 | 40 | |
| Mathematical Reasoning | OlympiadBench | Pass@162.1 | 39 | |
| Mathematical Reasoning | OlympiadBench | EM Score37.86 | 36 | |
| Mathematical Reasoning | OlympiadBench | Accuracy60.44 | 36 | |
| Mathematical Reasoning | OlympiadBench | Pass Rate60.67 | 36 | |
| Mathematical Reasoning | OlympiadBench | EM57.9 | 36 | |
| Mathematical reasoning | OlympiadBench | Pass@162.8 | 33 | |
| Math | OlympiadBench | Score77.59 | 31 | |
| Mathematical Reasoning | OlympiadBench 675 | Accuracy56.85 | 28 | |
| Mathematical Reasoning | OlympiadBench | Accuracy (avg@4)73.78 | 26 | |
| Mathematical Reasoning | OlympiadBench | Maj@1667.03 | 24 | |
| Mathematical Reasoning | OlympiadBench | Pass@1665.6 | 24 | |
| Mathematical Reasoning | OlympiadBench | Accuracy81 | 24 | |
| Mathematical Reasoning | OlympiadBench | Accuracy0.44 | 24 | |
| Mathematical Reasoning | OlympiadBench | Pass@861.2 | 24 |