Minerva Math
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Minerva Math | Accuracy93 | 251 | |
| Mathematical Reasoning | Minerva Math | Accuracy63.2 | 228 | |
| Mathematical Reasoning | Minerva Math | Accuracy80.1 | 124 | |
| Mathematical Reasoning | Minerva Math | pass@1 Accuracy52.9 | 104 | |
| Mathematical Reasoning | Minerva Math v1 (test) | Accuracy (avg@1)57.4 | 87 | |
| Math Reasoning | Minerva Math | Accuracy (%)48.5 | 73 | |
| Mathematical Reasoning | Minerva Math | Accuracy68.4 | 54 | |
| Mathematics | Minerva Math | Pass@1 Accuracy45.2 | 44 | |
| Mathematical Reasoning | Minerva-Math | Avg@1 Accuracy47.1 | 40 | |
| Mathematical Reasoning | Minerva Math | Pass@138.2 | 33 | |
| Mathematical Reasoning | Minerva Math | Minerva Math 4-shot Accuracy20.6 | 25 | |
| Mathematical Reasoning | Minerva-Math | maj@1646.32 | 24 | |
| Mathematical Reasoning | Minerva Math | Pass@145.2 | 22 | |
| Mathematics | Minerva Math | 4-shot Performance (%)15.52 | 21 | |
| Mathematical Reasoning | Minerva Math 4-shot | Flexibility (%)38.4 | 21 | |
| Mathematical Reasoning | Minerva-Math | Accuracy @426.5 | 20 | |
| Mathematical Reasoning | Minerva Math | Avg@443.9 | 19 | |
| Mathematical Reasoning | Minerva-Math | Accuracy38.97 | 17 | |
| Mathematical Reasoning | Minerva-Math | Last Score49.63 | 17 | |
| Mathematical Reasoning | Minerva-Math | Accuracy57.4 | 16 | |
| Mathematical Reasoning | Minerva Math | Accuracy (Avg@16)39 | 15 | |
| Mathematical Reasoning | Minerva Math | Avg@k37.09 | 15 | |
| Mathematical Reasoning | Minerva Math | Average Score (avg@8)54.3 | 14 | |
| Text Reasoning | Minerva Math | Accuracy59.74 | 14 | |
| Math Reasoning | Minerva Math | Average Accuracy @1640.1 | 14 |
Showing 25 of 42 rows