Zero-shot Evaluation on ARC-C, ARC-E, HellaSwag, PIQA, and WinoGrande (test val)
76Average Accuracy
FP16 Baseline
Updated 4d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2025.12 | 76 | - | - | - | - | - | |
2025.12 | 74.6 | - | - | - | - | - | |
2025.12 | 74 | - | - | - | - | - | |
2025.12 | 73 | - | - | - | - | - | |
2025.12 | 72.9 | - | - | - | - | - | |
2025.12 | 72.4 | - | - | - | - | - | |
2025.12 | 72.4 | - | - | - | - | - | |
2025.12 | 71.9 | - | - | - | - | - | |
2025.12 | 70.9 | - | - | - | - | - | |
2025.12 | 70.6 | - | - | - | - | - | |
2025.12 | 70.5 | - | - | - | - | - | |
2025.12 | 70 | - | - | - | - | - | |
2025.12 | 69.7 | - | - | - | - | - | |
2025.12 | 69.6 | - | - | - | - | - | |
2025.12 | 69.5 | - | - | - | - | - | |
2025.12 | 69.1 | - | - | - | - | - | |
2025.12 | 68.9 | - | - | - | - | - | |
2025.12 | 68.8 | - | - | - | - | - | |
2025.05 | 68.72 | 48.9 | 79.6 | 60.9 | 80.3 | 73.9 | |
2025.12 | 67.3 | - | - | - | - | - | |
2025.12 | 67.2 | - | - | - | - | - | |
2025.12 | 67 | - | - | - | - | - | |
2025.12 | 66.8 | - | - | - | - | - | |
2025.12 | 66.7 | - | - | - | - | - | |
2025.12 | 66.4 | - | - | - | - | - | |
2025.12 | 66.4 | - | - | - | - | - | |
2025.12 | 66.2 | - | - | - | - | - | |
2025.12 | 65.8 | - | - | - | - | - | |
2025.05 | 65.74 | 44.88 | 76.85 | 56.46 | 79.16 | 71.35 | |
2025.12 | 65.6 | - | - | - | - | - | |
2025.05 | 65.23 | 44.11 | 76.73 | 55.66 | 78.4 | 71.27 | |
2025.05 | 65.1 | 43.7 | 76.7 | 55.7 | 78.4 | 71 | |
2025.05 | 65 | 43.9 | 76.9 | 55.4 | 78.5 | 70.3 | |
2025.12 | 64.9 | - | - | - | - | - | |
2025.12 | 64.9 | - | - | - | - | - | |
2025.12 | 64.7 | - | - | - | - | - | |
2025.12 | 64.5 | - | - | - | - | - | |
2025.12 | 63.7 | - | - | - | - | - | |
2025.12 | 63.4 | - | - | - | - | - | |
2025.12 | 62.7 | - | - | - | - | - | |
2025.12 | 62.6 | - | - | - | - | - | |
2025.12 | 62.4 | - | - | - | - | - | |
2025.12 | 62.1 | - | - | - | - | - | |
2025.05 | 61.57 | 39.33 | 72.9 | 49.91 | 75.79 | 69.93 | |
2025.05 | 61.1 | 38.05 | 72.56 | 49.91 | 76.01 | 68.98 | |
2025.05 | 60.82 | 38 | 72.4 | 49.4 | 75 | 69.3 | |
2025.12 | 60.6 | - | - | - | - | - | |
2025.05 | 60.52 | 38.5 | 71.9 | 46.9 | 75.1 | 70.2 | |
2025.12 | 59.8 | - | - | - | - | - | |
2025.12 | 59.5 | - | - | - | - | - | |
2025.12 | 56.7 | - | - | - | - | - | |
2025.05 | 56.48 | 33.45 | 67.13 | 43.91 | 72.63 | 65.27 | |
2025.12 | 56.3 | - | - | - | - | - | |
2025.12 | 53.2 | - | - | - | - | - | |
2025.05 | 52.87 | 29.1 | 64.27 | 39.05 | 69.04 | 62.9 | |
2025.12 | 52.1 | - | - | - | - | - | |
2025.05 | 51.92 | 27.9 | 62.6 | 38.6 | 67 | 63.5 | |
2025.12 | 50.8 | - | - | - | - | - | |
2025.05 | 49.88 | 27.1 | 60.9 | 36.1 | 65.9 | 59.4 | |
2025.12 | 45.8 | - | - | - | - | - | |
2025.12 | 40.8 | - | - | - | - | - |