MATH500
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Math500 Level 5 | Accuracy71.1 | 54 | |
| Advanced Mathematical Reasoning | Math500 512 tokens | Pass@1 Accuracy46.3 | 15 | |
| Advanced Mathematical Reasoning | Math500 256 tokens | Pass@1 Accuracy41.2 | 15 | |
| Reasoning | MATH500 | MATH500 Average Score96.4 | 12 | |
| Mathematical Reasoning | MATH500 | Pass@185.6 | 10 | |
| Open Question Answering | MATH500 (test) | Accuracy0.94 | 9 | |
| Question Answering | Math500 (in-domain) | Accuracy95.2 | 5 |
Showing 7 of 7 rows