Minerva
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | Minerva | Pass@155.96 | 138 | |
| Mathematical Reasoning | Minerva | Pass@168.1 | 55 | |
| Mathematical Reasoning | Minerva | Accuracy (@avg1)40.1 | 33 | |
| Mathematical Reasoning | Minerva | Pass@1 (Avg@16)41.7 | 32 | |
| Mathematical Reasoning | Minerva | Avg@1640.9 | 30 | |
| Mathematical Reasoning | Minerva | Pass@140.14 | 22 | |
| Mathematical Reasoning | Minerva | Pass@127.3 | 18 | |
| Mathematical Reasoning | Minerva | pass@136 | 18 | |
| Mathematical Reasoning | Minerva | Pass@837.5 | 18 | |
| Mathematical Reasoning | Minerva | Pass@126.84 | 16 | |
| Mathematical Reasoning | Minerva | Avg@257.7 | 16 | |
| Reasoning | MINERVA | Accuracy44.02 | 15 | |
| Mathematical Reasoning | Minerva | Average Score @3239.4 | 14 | |
| Math and Text Reasoning | Minerva | PAQ0.4943 | 14 | |
| Mathematical Reasoning | Minerva | Acc@1626 | 12 | |
| Mathematical Reasoning | Minerva | Pass@1 Success Rate31.76 | 12 | |
| Mathematical Reasoning | Minerva | Pass@1 Rate37.5 | 12 | |
| Mathematical Reasoning | Minerva (test) | Acc24.6 | 12 | |
| Mathematical reasoning | Minerva | Avg@1646.78 | 12 | |
| Mathematical Reasoning | Minerva | Exact Match Accuracy29.78 | 10 | |
| Long Video Understanding | MINERVA | Accuracy65.6 | 9 | |
| Video Reasoning | MINERVA 600+s (test) | Accuracy31.8 | 8 | |
| Video Reasoning | MINERVA 0-600s (test) | Accuracy37.8 | 8 | |
| Video Reasoning | MINERVA overall (test) | Accuracy33.8 | 8 | |
| Mathematical Reasoning | Minerva | Average@425.5 | 7 |
Showing 25 of 35 rows