BrUMO
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Reasoning | BRUMO 2025 | Accuracy60.83 | 21 | |
| Mathematical Reasoning | BRUMO | Trace Count826 | 20 | |
| Reasoning | Brumo 25 | Trace Count613 | 20 | |
| Reasoning | BrUMO25 | Pass@194.58 | 14 | |
| Mathematical Reasoning | BRUMO | Accuracy67.5 | 7 | |
| Mathematical Reasoning | BRUMO 2025 (test) | Pass@1 Accuracy56.66 | 4 | |
| Mathematical Reasoning | BRUMO 2025 | Pass@451.42 | 2 |
Showing 7 of 7 rows