Minerva
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Minerva | Pass@1 Accuracy74.8 | 289 | |
| Mathematical Reasoning | Minerva | Accuracy (Acc)89.16 | 146 | |
| Mathematical Reasoning | Minerva | Pass@155.96 | 138 | |
| Mathematical Reasoning | Minerva | Pass@168.1 | 80 | |
| Mathematical Reasoning | Minerva | Accuracy (%)53.3 | 67 | |
| Mathematical Reasoning | Minerva | Pass@152.9 | 66 | |
| Mathematical Reasoning | Minerva | Accuracy (@avg1)54.9 | 57 | |
| Mathematical reasoning | Minerva | pass@1 Mean46.6 | 54 | |
| Mathematical Reasoning | Minerva | Pass@1 Accuracy54.53 | 52 | |
| Mathematical Reasoning | Minerva (test) | Acc45 | 46 | |
| Mathematical Reasoning | Minerva | Avg@1640.9 | 43 | |
| Mathematical reasoning | Minerva | Avg@1646.78 | 42 | |
| Math | Minerva | Accuracy89.16 | 40 | |
| Mathematical Reasoning | MINERVA | Pass@139.71 | 36 | |
| Mathematical Reasoning | Minerva | pass@139.7 | 32 | |
| Mathematical Reasoning | Minerva | Pass@1 (Avg@16)41.7 | 32 | |
| Mathematical Reasoning | Minerva | Accuracy54.53 | 30 | |
| Mathematical Reasoning | Minerva 272 | Accuracy (Minerva 272)42.53 | 28 | |
| Mathematical Reasoning | Minerva | Accuracy51.47 | 25 | |
| Math Reasoning | Minerva | Mean@1643.8 | 24 | |
| Mathematical Problem Solving | MINERVA | Pass@k37.5 | 24 | |
| Mathematical Reasoning | MINERVA | Pass@k38.4 | 24 | |
| Mathematical Reasoning | Minerva | Avg@k39.94 | 24 | |
| Mathematical Reasoning | Minerva | Pass@839.48 | 24 | |
| Math Reasoning | Minerva STEM evaluation | Accuracy16.16 | 23 |
Showing 25 of 86 rows