Zero-shot Reasoning on Reasoning Suite (ARC-e, ARC-c, HellaSwag, PIQA, Winogrande)
81.06ARC-e Accuracy
BF16
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2026.03 | 81.06 | 56.48 | 74.96 | 77.69 | 68.03 | 71.64 | 100 | |
2026.03 | 80.81 | 55.72 | 73.29 | 77.09 | 66.93 | 70.77 | 98.75 | |
2026.03 | 80.68 | 56.06 | 72.95 | 77.53 | 66.46 | 70.74 | 98.72 | |
2026.03 | 80.6 | 55.89 | 73.16 | 77.31 | 67.09 | 70.81 | 98.82 | |
2026.03 | 80.51 | 55.72 | 72.86 | 76.55 | 66.93 | 70.51 | 98.42 | |
2026.03 | 79.92 | 56.14 | 73.1 | 77.97 | 68.59 | 71.14 | 99.34 | |
2026.03 | 79.84 | 55.38 | 72.54 | 76.88 | 66.22 | 70.17 | 97.92 | |
2026.03 | 79.8 | 55.63 | 73.15 | 77.09 | 67.17 | 70.57 | 98.5 | |
2026.03 | 79.63 | 55.72 | 72.66 | 76.82 | 66.22 | 70.21 | 98.01 | |
2026.03 | 79.21 | 55.03 | 72.76 | 76.99 | 67.4 | 70.28 | 98.08 | |
2026.03 | 79.04 | 55.8 | 72.38 | 76.55 | 66.85 | 70.12 | 97.93 | |
2026.03 | 78.87 | 53.67 | 73.27 | 76.66 | 66.93 | 69.88 | 97.43 | |
2026.03 | 78.7 | 55.2 | 72.77 | 76.88 | 65.11 | 69.73 | 97.31 | |
2026.03 | 78.54 | 53.33 | 69.53 | 76.66 | 65.19 | 68.65 | 95.71 | |
2026.03 | 78.2 | 50.6 | 70.36 | 75.63 | 63.54 | 67.67 | 94.13 | |
2026.03 | 78.11 | 52.99 | 73.09 | 76.88 | 67.8 | 69.77 | 97.26 | |
2026.03 | 77.9 | 52.13 | 69.6 | 75.14 | 62.51 | 67.46 | 93.97 | |
2026.03 | 77.65 | 53.5 | 72.56 | 77.53 | 65.9 | 69.43 | 96.8 | |
2026.03 | 77.53 | 53.33 | 71.12 | 75.3 | 66.22 | 68.7 | 95.84 | |
2026.03 | 77.1 | 52.56 | 72.46 | 77.09 | 68.19 | 69.48 | 96.86 | |
2026.03 | 76.98 | 54.69 | 72.76 | 78.07 | 66.85 | 69.87 | 97.52 | |
2026.03 | 76.98 | 51.28 | 70.47 | 75.79 | 64.56 | 67.82 | 94.44 | |
2026.03 | 76.89 | 52.47 | 70.44 | 74.16 | 64.8 | 67.75 | 94.49 | |
2026.03 | 76.89 | 51.96 | 70.54 | 75.08 | 63.61 | 67.62 | 94.22 | |
2026.03 | 76.52 | 52.39 | 71.25 | 75.73 | 65.35 | 68.25 | 95.15 | |
2026.03 | 76.47 | 52.73 | 70.15 | 74.81 | 62.27 | 67.29 | 93.82 | |
2026.03 | 75.97 | 50.68 | 70.38 | 74.65 | 62.43 | 66.82 | 93.04 | |
2026.03 | 75.72 | 50.09 | 70.15 | 74.37 | 64.64 | 66.99 | 93.29 | |
2026.03 | 74.71 | 48.55 | 68.79 | 75.24 | 63.93 | 66.24 | 92.14 | |
2026.03 | 74.28 | 50.43 | 67.55 | 73.67 | 63.38 | 65.86 | 91.81 | |
2026.03 | 74.07 | 49.32 | 69.82 | 75.95 | 63.3 | 66.49 | 92.53 | |
2026.03 | 73.23 | 49.74 | 69.61 | 75.24 | 66.85 | 66.93 | 93.28 | |
2026.03 | 68.18 | 45.65 | 67.41 | 74.21 | 62.19 | 63.53 | 88.36 | |
2025.12 | 0.7559 | 0.4317 | 0.5706 | 0.7791 | 0.6985 | 0.6472 | - | |
2025.12 | 0.7273 | 0.3976 | 0.5333 | 0.7617 | 0.6803 | 0.62 | - | |
2025.12 | 0.6368 | 0.3276 | 0.4955 | 0.7476 | 0.6567 | 0.5728 | - | |
2025.12 | 0.5846 | 0.3106 | 0.4521 | 0.7149 | 0.5919 | 0.5308 | - | |
2025.12 | 0.5656 | 0.2482 | 0.3819 | 0.7008 | 0.5367 | 0.4866 | - | |
2025.12 | 0.5593 | 0.2415 | 0.3843 | 0.698 | 0.5517 | 0.487 | - | |
2025.12 | 0.5556 | 0.2884 | 0.4294 | 0.7138 | 0.6243 | 0.5223 | - | |
2025.12 | 0.5332 | 0.227 | 0.3557 | 0.6681 | 0.5264 | 0.4621 | - |