Multistep Soft Reasoning on MuSR
69Accuracy
GPT-OSS-120B
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 69 | 12,700 | - | - | |
2026.04 | 64.83 | 7,195 | 3.81 | 46.38 | |
2026.04 | 62.45 | 13,419 | - | - | |
2026.04 | 59.5 | 5,994 | -13.77 | 52.8 | |
2026.04 | 50.65 | 1,328 | - | - | |
2024.12 | 46.39 | - | - | - | |
2024.12 | 45.58 | - | - | - | |
2024.12 | 44.91 | - | - | - | |
2024.12 | 44.79 | - | - | - | |
2024.12 | 44.51 | - | - | - | |
2024.12 | 43.19 | - | - | - | |
2024.12 | 43.11 | - | - | - | |
2024.12 | 42.06 | - | - | - | |
2024.12 | 41.74 | - | - | - | |
2024.12 | 41.7 | - | - | - | |
2024.12 | 41.65 | - | - | - | |
2024.12 | 41.59 | - | - | - | |
2024.12 | 41.11 | - | - | - | |
2024.12 | 41.07 | - | - | - | |
2024.12 | 40.94 | - | - | - | |
2024.12 | 40.73 | - | - | - | |
2024.12 | 40.72 | - | - | - | |
2024.12 | 40.68 | - | - | - | |
2024.12 | 40.59 | - | - | - | |
2024.12 | 40.57 | - | - | - | |
2024.12 | 40.32 | - | - | - | |
2024.12 | 39.92 | - | - | - | |
2024.12 | 39.77 | - | - | - | |
2024.12 | 39.46 | - | - | - | |
2024.12 | 39.32 | - | - | - | |
2024.12 | 39.05 | - | - | - | |
2024.12 | 39.05 | - | - | - | |
2024.12 | 38.81 | - | - | - | |
2024.12 | 37.99 | - | - | - | |
2024.12 | 37.92 | - | - | - | |
2024.12 | 37.6 | - | - | - | |
2026.04 | 37.41 | 25,600 | - | - | |
2024.12 | 37.32 | - | - | - | |
2026.04 | 34 | 5,912 | -9.12 | 76.91 | |
2026.04 | 29 | 1,603 | - | - | |
2026.04 | 10.33 | 1,061 | - | - |