Zero-shot Evaluation on PIQA, WinoGrande, HellaSwag, ARC (Easy and Challenge), and LAMBADA (test)
77.07Average Accuracy
FP16
Updated 4d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2024.03 | 77.07 | 82.7 | 77.98 | 83.84 | 80.98 | 57.34 | 79.58 | |
2024.03 | 75.98 | 82.43 | 76.24 | 81.82 | 80.43 | 56.23 | 78.73 | |
2025.12 | 75.28 | - | - | - | - | - | - | |
2024.03 | 73.18 | 80.25 | 74.19 | 78.54 | 80.35 | 57.08 | 68.64 | |
2024.03 | 73.11 | 80.47 | 73.72 | 78.45 | 80.13 | 57.51 | 68.37 | |
2024.03 | 73.02 | 79.71 | 74.11 | 78.63 | 80.47 | 56.66 | 68.56 | |
2025.12 | 72.71 | - | - | - | - | - | - | |
| 72.68 | - | - | - | - | - | - | ||
2024.03 | 72.67 | 79.54 | 72.69 | 78.5 | 79.42 | 56.74 | 68.85 | |
2024.03 | 72.59 | 80.47 | 72.22 | 79.39 | 77.48 | 49.23 | 76.75 | |
2025.12 | 72.37 | - | - | - | - | - | - | |
| 72.32 | - | - | - | - | - | - | ||
2024.03 | 71.98 | 79.54 | 73.01 | 77.46 | 79.21 | 55.12 | 67.53 | |
2025.12 | 71.97 | - | - | - | - | - | - | |
| 70.93 | - | - | - | - | - | - | ||
2025.12 | 70.91 | - | - | - | - | - | - | |
2025.12 | 70.84 | - | - | - | - | - | - | |
2025.12 | 70.6 | - | - | - | - | - | - | |
| 70.6 | - | - | - | - | - | - | ||
2025.12 | 70.25 | - | - | - | - | - | - | |
| 70.16 | - | - | - | - | - | - | ||
2025.12 | 70.1 | - | - | - | - | - | - | |
| 70.04 | - | - | - | - | - | - | ||
2025.12 | 69.85 | - | - | - | - | - | - | |
2024.03 | 69.82 | 79.11 | 69.06 | 75.99 | 74.58 | 46.25 | 73.9 | |
2024.03 | 69.79 | 78.89 | 70.24 | 76.37 | 72.98 | 46.59 | 73.67 | |
2025.12 | 69.48 | - | - | - | - | - | - | |
| 69.3 | - | - | - | - | - | - | ||
2025.12 | 69.02 | - | - | - | - | - | - | |
2025.12 | 68.93 | - | - | - | - | - | - | |
| 68.82 | - | - | - | - | - | - | ||
2025.12 | 68.64 | - | - | - | - | - | - | |
2025.12 | 68.39 | - | - | - | - | - | - | |
2025.12 | 67.89 | - | - | - | - | - | - | |
2025.12 | 67.7 | - | - | - | - | - | - | |
2025.12 | 67.57 | - | - | - | - | - | - | |
2025.12 | 67.44 | - | - | - | - | - | - | |
2024.03 | 66.34 | 75.35 | 67.88 | 72.95 | 72.98 | 48.12 | 60.78 | |
2024.03 | 65.64 | 76.77 | 63.77 | 72.16 | 69.87 | 40.87 | 70.39 | |
2025.12 | 64.95 | - | - | - | - | - | - | |
2025.12 | 64.76 | - | - | - | - | - | - | |
2025.12 | 64.66 | - | - | - | - | - | - | |
| 64.57 | - | - | - | - | - | - | ||
2025.12 | 64.48 | - | - | - | - | - | - | |
2025.12 | 64.44 | - | - | - | - | - | - | |
2025.12 | 64.1 | - | - | - | - | - | - | |
2025.12 | 64.09 | - | - | - | - | - | - | |
2025.12 | 63.88 | - | - | - | - | - | - | |
| 63.73 | - | - | - | - | - | - | ||
2025.12 | 63.67 | - | - | - | - | - | - | |
2025.12 | 63.65 | - | - | - | - | - | - | |
| 63.56 | - | - | - | - | - | - | ||
| 62.81 | - | - | - | - | - | - | ||
2025.12 | 62.76 | - | - | - | - | - | - | |
| 62.6 | - | - | - | - | - | - | ||
| 62.34 | - | - | - | - | - | - | ||
2025.12 | 62.22 | - | - | - | - | - | - | |
2025.12 | 61.88 | - | - | - | - | - | - | |
2025.12 | 61.85 | - | - | - | - | - | - | |
2025.12 | 60.76 | - | - | - | - | - | - | |
2025.12 | 60.72 | - | - | - | - | - | - | |
2025.12 | 60.61 | - | - | - | - | - | - | |
| 60.44 | - | - | - | - | - | - | ||
| 60.38 | - | - | - | - | - | - | ||
| 60.28 | - | - | - | - | - | - | ||
2025.12 | 60.14 | - | - | - | - | - | - | |
2025.12 | 60.08 | - | - | - | - | - | - | |
2025.12 | 60.06 | - | - | - | - | - | - | |
| 59.97 | - | - | - | - | - | - | ||
2025.12 | 59.96 | - | - | - | - | - | - | |
2025.12 | 59.5 | - | - | - | - | - | - | |
2025.12 | 59.37 | - | - | - | - | - | - | |
| 59.04 | - | - | - | - | - | - | ||
2025.12 | 59.02 | - | - | - | - | - | - | |
| 58.67 | - | - | - | - | - | - | ||
2025.12 | 57.88 | - | - | - | - | - | - | |
2025.12 | 57.61 | - | - | - | - | - | - | |
2024.03 | 56.12 | 68.39 | 58.64 | 60.6 | 65.87 | 39.25 | 43.99 | |
2025.12 | 55.25 | - | - | - | - | - | - | |
2025.12 | 54.87 | - | - | - | - | - | - | |
2025.12 | 54.5 | - | - | - | - | - | - | |
2025.12 | 53.56 | - | - | - | - | - | - | |
2025.12 | 52.66 | - | - | - | - | - | - | |
2025.12 | 48.29 | - | - | - | - | - | - | |
2025.12 | 46.98 | - | - | - | - | - | - | |
2025.12 | 41.56 | - | - | - | - | - | - | |
2025.12 | 35.99 | - | - | - | - | - | - | |
2025.12 | 35.49 | - | - | - | - | - | - | |
2025.12 | 34.74 | - | - | - | - | - | - | |
2025.12 | 34.38 | - | - | - | - | - | - |