Zero-shot Performance on LMEval Harness Subset (HellaSwag, BoolQ, WinoGrande, PiQA, ARC)
75.46Mean Accuracy
GIFT-SW
Updated 4d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2024.08 | 75.46 | - | - | - | - | - | - | |
2024.08 | 75.29 | - | - | - | - | - | - | |
2024.08 | 74.84 | - | - | - | - | - | - | |
2024.08 | 74.5 | - | - | - | - | - | - | |
2024.08 | 74.37 | - | - | - | - | - | - | |
2024.08 | 74.34 | - | - | - | - | - | - | |
2026.02 | 74.31 | 73.32 | 80.9 | 79.23 | 81.31 | 77.74 | 53.33 | |
2024.08 | 74.27 | - | - | - | - | - | - | |
2024.08 | 73.27 | - | - | - | - | - | - | |
2026.02 | 73.26 | 73.24 | 80.23 | 77.88 | 80.18 | 76.76 | 51.26 | |
2026.02 | 73.23 | 73.69 | 80.34 | 78.16 | 79.99 | 76.48 | 50.7 | |
2026.02 | 73.23 | 72.3 | 80.52 | 79.38 | 80.58 | 77.53 | 49.06 | |
2026.02 | 73.08 | 73.09 | 80.27 | 77.83 | 79.94 | 76.62 | 50.72 | |
2026.02 | 73.05 | 73.16 | 80.12 | 78.14 | 79.58 | 76.67 | 50.61 | |
2026.02 | 72.98 | 73.51 | 80.19 | 77.97 | 80.28 | 76 | 49.95 | |
2026.02 | 72.8 | 72.38 | 80.11 | 78.65 | 79.86 | 76.95 | 48.82 | |
2026.02 | 72.79 | 72.58 | 79.87 | 78.75 | 79.98 | 76.79 | 48.75 | |
2026.02 | 72.71 | 71.87 | 79.83 | 78.8 | 80.09 | 76.88 | 48.82 | |
2026.02 | 72.67 | 72.06 | 79.99 | 78.75 | 79.79 | 76.69 | 48.75 | |
2026.02 | 72.62 | 72.06 | 79.91 | 78.78 | 79.42 | 76.83 | 48.72 | |
2024.08 | 72.53 | - | - | - | - | - | - | |
2024.08 | 72.43 | - | - | - | - | - | - | |
2024.08 | 71.65 | - | - | - | - | - | - | |
2024.08 | 71.3 | - | - | - | - | - | - | |
2026.02 | 71.11 | 71.19 | 79.07 | 75.95 | 78.85 | 74.94 | 46.63 | |
2024.08 | 71.08 | - | - | - | - | - | - | |
2026.02 | 71.06 | 70.69 | 79.44 | 76.03 | 78.33 | 75.18 | 46.72 | |
2024.08 | 71 | - | - | - | - | - | - | |
2026.02 | 71 | 70.83 | 79.36 | 76.36 | 79.05 | 74.11 | 46.42 | |
2026.02 | 70.97 | 70.26 | 79.11 | 76.24 | 78.94 | 74.8 | 46.47 | |
2026.02 | 70.93 | 70.54 | 79.27 | 76.32 | 79.08 | 73.91 | 46.45 | |
2026.02 | 70.47 | 69.06 | 79.11 | 75.98 | 77.74 | 74.62 | 46.33 | |
2024.08 | 70.24 | - | - | - | - | - | - | |
2024.08 | 69.82 | - | - | - | - | - | - | |
2026.02 | 69.65 | 69.2 | 78.58 | 75.14 | 76.41 | 73.47 | 45.07 | |
2026.02 | 69.58 | 69.14 | 78.4 | 75.11 | 77.25 | 73.13 | 44.47 | |
2026.02 | 69.54 | 69.69 | 78.44 | 75.21 | 76.77 | 73.04 | 44.11 | |
2026.02 | 69.49 | 68.83 | 78.56 | 75.07 | 76.2 | 73.49 | 44.81 | |
2026.02 | 69.43 | 69.72 | 78.52 | 75.16 | 75.32 | 73.3 | 44.57 | |
2026.02 | 69.33 | 70.64 | 77.56 | 73.28 | 77.55 | 71.62 | 45.36 | |
2024.08 | 67.61 | - | - | - | - | - | - | |
2026.02 | 67.6 | 70.48 | 76.43 | 73.06 | 76.36 | 67.54 | 41.76 | |
2026.02 | 67.34 | 68.02 | 77.4 | 71.69 | 75.07 | 70.18 | 41.37 | |
2026.02 | 66.82 | 69.14 | 75.52 | 73.07 | 73.76 | 67.1 | 42.32 | |
2026.02 | 66.82 | 67.48 | 77.68 | 71.55 | 72.94 | 70.02 | 41.26 | |
2026.02 | 66.5 | 66.84 | 77.02 | 71.73 | 74.12 | 68.49 | 40.79 | |
2026.02 | 66.34 | 66.71 | 77.27 | 72 | 73.1 | 68.11 | 40.84 | |
2026.02 | 66.14 | 65.97 | 76.71 | 71.88 | 73.11 | 67.93 | 41.21 | |
2026.02 | 65.77 | 69.66 | 74.7 | 73.89 | 74.75 | 61.89 | 39.76 | |
2026.02 | 65.2 | 69.82 | 74.97 | 70.81 | 71.27 | 63.47 | 40.84 | |
2024.08 | 63.99 | - | - | - | - | - | - | |
2024.08 | 62.91 | - | - | - | - | - | - | |
2024.08 | 62.19 | - | - | - | - | - | - | |
2024.08 | 61.09 | - | - | - | - | - | - | |
2024.08 | 58.89 | - | - | - | - | - | - | |
2024.08 | 58.2 | - | - | - | - | - | - | |
2024.08 | 53.8 | - | - | - | - | - | - | |
2024.08 | 48.96 | - | - | - | - | - | - | |
2024.08 | 47.14 | - | - | - | - | - | - | |
2024.08 | 41.44 | - | - | - | - | - | - |