Zero-shot Reasoning on (OpenbookQA, ARC-e, ARC-c, WinoGrande, HellaSwag, PIQA, MathQA)
54.92Average Accuracy
LittleBit
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2026.02 | 54.92 | - | - | - | - | - | - | - | - | |
2026.02 | 54.24 | - | - | - | - | - | - | - | - | |
2026.02 | 52.3 | - | - | - | - | - | - | - | - | |
2026.02 | 52 | 28 | 67 | 38 | 67 | 56 | 78 | 27 | 0 | |
2026.02 | 51.01 | - | - | - | - | - | - | - | - | |
2026.02 | 50.63 | - | - | - | - | - | - | - | - | |
2026.02 | 50 | 29 | 68 | 36 | 65 | 45 | 75 | 25 | 390 | |
2026.02 | 47.32 | - | - | - | - | - | - | - | - | |
2026.02 | 47 | 27 | 63 | 33 | 64 | 45 | 71 | 24 | 920 | |
2026.02 | 46 | 26 | 59 | 31 | 66 | 44 | 70 | 23 | 1,080 | |
2026.02 | 44 | 22 | 58 | 29 | 63 | 43 | 69 | 24 | 1,470 | |
2026.02 | 43 | 25 | 53 | 27 | 64 | 41 | 68 | 24 | 1,670 | |
2026.02 | 41 | 23 | 50 | 29 | 62 | 36 | 65 | 23 | 2,110 | |
2026.02 | 40 | 22 | 50 | 30 | 61 | 36 | 64 | 22 | 2,280 | |
2026.02 | 38 | 22 | 41 | 27 | 58 | 34 | 61 | 23 | 2,630 | |
2026.02 | 37 | 19 | 42 | 25 | 58 | 33 | 60 | 21 | 2,830 | |
2026.02 | 34 | 16 | 33 | 25 | 52 | 30 | 54 | 23 | 3,410 | |
2026.02 | 32 | 15 | 31 | 20 | 52 | 28 | 54 | 22 | 3,800 | |
2026.02 | 31 | 14 | 28 | 22 | 50 | 27 | 55 | 21 | 3,990 | |
2026.02 | 30 | 13 | 28 | 22 | 48 | 26 | 55 | 19 | 4,180 | |
2026.02 | 29 | 12 | 26 | 21 | 49 | 26 | 53 | 18 | 4,380 | |
2026.02 | 2 | 9 | 11 | 6 | 5 | 8 | 10 | 5 | 9,600 | |
2026.02 | 2 | 6 | 5 | 2 | 2 | 0 | 5 | 3 | 9,660 | |
2026.02 | 1 | 6 | 1 | 0 | 0 | 1 | 1 | 0 | 9,780 |