Zero-shot Commonsense Reasoning on ARC-e, ARC-c, HellaSwag, PIQA, WinoGrande (test)
74.5ARC-e Accuracy
BF16
Updated 4d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.01 | 74.5 | 42.2 | 55.2 | 76.8 | 69.1 | 63.6 | |
2026.01 | 74.1 | 39.3 | 49.1 | 75.7 | 62.2 | 60.1 | |
2026.01 | 70.2 | 34.6 | 46.4 | 73.9 | 62.7 | 57.6 | |
2026.01 | 69.2 | 35.1 | 46.2 | 73.4 | 58.6 | 56.5 | |
2026.01 | 68.7 | 34.8 | 42.3 | 72.7 | 55.8 | 54.9 | |
2026.01 | 67.2 | 32.9 | 43.9 | 73.5 | 58.2 | 55.1 | |
2026.01 | 66.5 | 35 | 41.8 | 72.6 | 57.7 | 54.7 | |
2026.01 | 65.4 | 31.3 | 47.7 | 74.2 | 60.3 | 55.8 | |
2026.01 | 64.5 | 30.5 | 39.1 | 71 | 54.2 | 51.9 | |
2026.01 | 61.9 | 26.2 | 35.4 | 69.2 | 52.7 | 49.1 | |
2026.01 | 60.3 | 25.9 | 36 | 68.3 | 54.1 | 48.9 | |
2026.01 | 49.8 | 23.1 | 30.3 | 64.5 | 52.9 | 44.1 | |
2026.01 | 43.1 | 20 | 29.4 | 59.9 | 52.2 | 40.9 | |
2026.01 | 42.4 | 17.4 | 25.6 | 56.3 | 51.3 | 38.6 | |
2026.01 | 42.1 | 18 | 27.3 | 60.4 | 51 | 39.8 | |
2026.01 | 40.7 | 22 | 28.4 | 60.1 | 49.2 | 40.1 | |
2026.01 | 37.6 | 17.7 | 25.8 | 57.4 | 50.6 | 37.8 | |
2026.01 | 36.1 | 16.1 | 26 | 57.2 | 49.6 | 37 |