Reasoning on ARC Challenge (ACC, NLL, ECE, MCE)
88.2Accuracy (ACC)
MAP
Updated 2mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.03 | 88.2 | 0.923 | 20.1 | 42.8 | |
2026.03 | 88 | 0.146 | 2.8 | 22.8 | |
2026.03 | 88 | 0.122 | 1.2 | 18.5 | |
2026.03 | 87.8 | 0.125 | 1.6 | 19.6 | |
2026.03 | 87.2 | 0.138 | 3 | 26.6 | |
2026.03 | 87.2 | 0.164 | 2 | 20.8 | |
2026.03 | 82.4 | 0.208 | 3.8 | 28.4 | |
2026.03 | 76.2 | 1.422 | 10.2 | 30.4 | |
2026.03 | 76 | 0.924 | 3.8 | 28.6 | |
2026.03 | 75.8 | 1.852 | 25.2 | 62.4 | |
2026.03 | 74.8 | 0.902 | 9.2 | 25.2 | |
2026.03 | 74.8 | 0.892 | 2.2 | 20.4 | |
2026.03 | 74.6 | 1.122 | 20.2 | 38.7 | |
2026.03 | 73.2 | 1.134 | 19.8 | 44.6 | |
2025.06 | 69.46 | 1.43 | 17.49 | - | |
2025.06 | 69.1 | 2.85 | 29 | - | |
2025.06 | 68.9 | 1.4 | 17.47 | - | |
2025.06 | 68.69 | 2.67 | 27.53 | - | |
2025.06 | 68.68 | 2.93 | 30.45 | - | |
2025.06 | 68.37 | 2.99 | 30.73 | - | |
2025.06 | 68.13 | 2.23 | 26.23 | - | |
2025.06 | 66.2 | 2.46 | 29.16 | - | |
2026.03 | 59.2 | 1.242 | 18.8 | 64.6 | |
2026.03 | 58.4 | 0.672 | 17.8 | 54.2 | |
2026.03 | 58 | 1.462 | 23.7 | 82.6 | |
2026.03 | 57.2 | 0.422 | 14.6 | 56.3 | |
2026.03 | 56.8 | 1.183 | 19.8 | 84.2 | |
2026.03 | 56.4 | 1.084 | 19.2 | 84.8 | |
2026.03 | 56.2 | 0.724 | 15.8 | 56.2 |