Zero-shot Reasoning on Reasoning Suite (PIQA, HellaSwag, WinoGrande, ARC-e, ARC-c) (val test)
76.55Average Accuracy
FP16
Updated 20d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.05 | 76.55 | - | - | - | - | - | |
2026.05 | 76.33 | - | - | - | - | - | |
2025.05 | 75.62 | 85.56 | 79.27 | 77.94 | 78.84 | 56.49 | |
2026.05 | 75 | - | - | - | - | - | |
2026.05 | 74.48 | 81.01 | 79.3 | 74.43 | 82.87 | 54.78 | |
2026.05 | 73.78 | - | - | - | - | - | |
2026.05 | 72.67 | - | - | - | - | - | |
2026.05 | 72.57 | 79.71 | 77.86 | 72.3 | 78.87 | 54.1 | |
2024.06 | 72.54 | 81.77 | 64.84 | 74.51 | 84.22 | 57.34 | |
2026.05 | 72.53 | 80.36 | 78.13 | 71.51 | 79.76 | 52.9 | |
2026.05 | 72.38 | - | - | - | - | - | |
2025.05 | 72.24 | 79.11 | 73.83 | 75.77 | 78.32 | 54.18 | |
2026.05 | 72.09 | 80.25 | 77.96 | 71.03 | 78.91 | 52.3 | |
2026.05 | 71.91 | 78.84 | 77.98 | 71.82 | 78.7 | 52.22 | |
2025.06 | 71.79 | 80.52 | 79.36 | 72.3 | 77.53 | 49.23 | |
2025.06 | 71.79 | 80.52 | 79.36 | 72.3 | 77.53 | 49.23 | |
2026.02 | 71.76 | 80.47 | 79.39 | 72.22 | 77.48 | 49.23 | |
2025.05 | 71.76 | 80.47 | 79.39 | 72.22 | 77.48 | 49.23 | |
2026.05 | 71.71 | - | - | - | - | - | |
2026.05 | 71.53 | 77.58 | 74.86 | 67.64 | 80.89 | 56.66 | |
2026.05 | 71.47 | - | - | - | - | - | |
2026.05 | 70.68 | 77.26 | 73.19 | 68.35 | 79.42 | 55.2 | |
2026.05 | 70.12 | 76.22 | 73.58 | 67.72 | 78.41 | 54.69 | |
2026.05 | 69.15 | 75.68 | 73.24 | 64.09 | 79.25 | 53.5 | |
2026.02 | 69 | 79.11 | 75.99 | 69.06 | 74.58 | 46.25 | |
2026.02 | 69 | 79.11 | 75.99 | 69.06 | 74.58 | 46.25 | |
2025.05 | 69 | 79.11 | 75.99 | 69.06 | 74.58 | 46.25 | |
2026.05 | 68.96 | - | - | - | - | - | |
2025.06 | 68.95 | 79.11 | 75.99 | 68.82 | 74.58 | 46.25 | |
2026.05 | 68.75 | 75.63 | 73.27 | 66.54 | 73.27 | 55.03 | |
2025.05 | 68.6 | 79.7 | 60.2 | 72.6 | 80.1 | 50.4 | |
2024.06 | 68.59 | 79.71 | 60.19 | 72.61 | 80.09 | 50.34 | |
2025.05 | 68.44 | 77.25 | 72.26 | 71.63 | 71.49 | 49.58 | |
2025.05 | 68.38 | 77.36 | 72.82 | 71.33 | 70.75 | 49.66 | |
2026.05 | 68.38 | 75.08 | 68.46 | 65.9 | 78.45 | 54.01 | |
2025.06 | 68.37 | 77.58 | 74.29 | 70.24 | 74.16 | 45.56 | |
2026.05 | 68.29 | - | - | - | - | - | |
2025.06 | 68.25 | 78.18 | 74.11 | 69.85 | 72.77 | 46.33 | |
2025.06 | 68.07 | 77.53 | 73.94 | 70.88 | 73.23 | 44.8 | |
2025.06 | 67.93 | 77.58 | 73.43 | 70.48 | 73.19 | 44.97 | |
2025.06 | 67.81 | 76.93 | 74.77 | 69.61 | 70.12 | 47.61 | |
2025.06 | 67.5 | 76.77 | 71.71 | 70.56 | 73.4 | 45.05 | |
2026.02 | 67.5 | 76.33 | 73.44 | 71.11 | 72.1 | 44.54 | |
2026.05 | 67.17 | - | - | - | - | - | |
2025.06 | 67.16 | 76.5 | 71.19 | 70.32 | 73.32 | 44.45 | |
2026.05 | 66.83 | 76.66 | 71.55 | 66.83 | 71.09 | 46.25 | |
2026.02 | 66.73 | 77.48 | 72.18 | 68.27 | 72.98 | 42.75 | |
2026.05 | 66.51 | - | - | - | - | - | |
2026.02 | 66.24 | 74.97 | 73.01 | 68.75 | 67.4 | 45.05 | |
2025.05 | 66.17 | 75.38 | 70.12 | 69.25 | 68.54 | 47.57 | |
2026.05 | 66 | 76.17 | 70.7 | 67.88 | 70.03 | 45.22 | |
2026.05 | 65.86 | 74.32 | 66.68 | 63.14 | 74.24 | 50.94 | |
2026.05 | 65.79 | 73.61 | 66.54 | 63.77 | 74.79 | 50.26 | |
2026.02 | 65.59 | 77.09 | 71.3 | 66.3 | 71.36 | 41.89 | |
2026.02 | 65.52 | 76.22 | 69.59 | 68.19 | 71.71 | 41.89 | |
2026.02 | 65.48 | 79.22 | 76.92 | 66.46 | 62.16 | 42.66 | |
2026.05 | 65.19 | 76.17 | 70.79 | 67.01 | 67.85 | 44.11 | |
2025.05 | 65.18 | 75.06 | 64.96 | 69.18 | 71.43 | 45.26 | |
2025.05 | 65.11 | 74.56 | 64.79 | 69.34 | 71.25 | 45.63 | |
2026.05 | 65.09 | 73.07 | 65.94 | 61.01 | 74.49 | 50.94 | |
2026.05 | 65.02 | 75.63 | 70.38 | 65.11 | 69.36 | 44.62 | |
2026.02 | 64.99 | 77.2 | 68.07 | 66.3 | 70.45 | 42.92 | |
2025.05 | 64.86 | 74.69 | 66.36 | 67.52 | 69.43 | 46.31 | |
2026.05 | 64.74 | 75.63 | 70.03 | 65.43 | 69.28 | 43.34 | |
2024.06 | 64.69 | 78.02 | 57.17 | 68.43 | 76.3 | 43.51 | |
2025.05 | 64.67 | 76.17 | 54.92 | 72.14 | 76.18 | 43.94 | |
2025.06 | 64.64 | 76.39 | 70.2 | 66.3 | 68.01 | 42.32 | |
2026.02 | 64.53 | 76.93 | 72.2 | 66.3 | 65.82 | 41.38 | |
2025.05 | 64.32 | 76.28 | 54.3 | 71.27 | 75.84 | 43.9 | |
2025.05 | 64.3 | 75.7 | 54 | 72.2 | 75.8 | 43.8 | |
2025.06 | 64.28 | 73.94 | 69.72 | 67.4 | 68.35 | 41.98 | |
2025.05 | 64.26 | 76.1 | 54.2 | 71.7 | 75.7 | 43.6 | |
2025.06 | 64.1 | 74.71 | 66.12 | 67.17 | 71.38 | 41.04 | |
2025.05 | 64.09 | 73.62 | 68.55 | 68.73 | 66.16 | 43.39 | |
2026.02 | 63.83 | 74.59 | 70.74 | 67.4 | 64.44 | 41.98 | |
2026.05 | 63.83 | 71.65 | 66.11 | 60.3 | 73.06 | 48.04 | |
2026.02 | 63.6 | 76.8 | 55.2 | 69.1 | 74.5 | 42.2 | |
2026.05 | 63.36 | - | - | - | - | - | |
2025.06 | 63.2 | 75.03 | 66.42 | 66.06 | 70.03 | 38.48 | |
2025.05 | 63.12 | 72.74 | 67.74 | 64.12 | 65.84 | 45.16 | |
2026.02 | 63.05 | 73.72 | 66.8 | 66.61 | 66.12 | 41.98 | |
2025.05 | 62.96 | 73.26 | 62.25 | 68.37 | 67.54 | 43.38 | |
2026.05 | 62.65 | - | - | - | - | - | |
2026.02 | 62.6 | 72.74 | 67.8 | 70.8 | 60.35 | 41.3 | |
2026.02 | 62.49 | 72.74 | 68.45 | 66.54 | 63.43 | 41.3 | |
2026.05 | 62.38 | - | - | - | - | - | |
2025.06 | 62.19 | 73.83 | 63.92 | 68.35 | 65.61 | 39.25 | |
2026.02 | 62.15 | 77.48 | 67.13 | 61.88 | 65.78 | 38.48 | |
2025.06 | 61.89 | 76.82 | 69.88 | 65.19 | 61.83 | 35.75 | |
2025.05 | 61.79 | 76.82 | 69.81 | 64.8 | 61.87 | 35.67 | |
2025.06 | 61.73 | 76.44 | 68.41 | 64.96 | 62.25 | 36.6 | |
2025.06 | 61.67 | 73.56 | 69.4 | 63.3 | 61.83 | 40.27 | |
2025.06 | 61.65 | 74.37 | 66.91 | 67.4 | 62.88 | 36.69 | |
2026.02 | 61.34 | 76.66 | 66.13 | 61.17 | 64.86 | 37.88 | |
2025.05 | 61.13 | 72.35 | 59.43 | 65.78 | 65.36 | 42.73 | |
2025.06 | 61.1 | 76.39 | 66.78 | 60.7 | 63.47 | 38.14 | |
2025.05 | 60.84 | 74.15 | 68.82 | 64.47 | 61.55 | 35.23 | |
2025.05 | 60.71 | 74.58 | 68.45 | 64.37 | 61.29 | 34.87 | |
2025.06 | 60.67 | 76.22 | 68.27 | 63.61 | 58.71 | 36.52 | |
2025.06 | 60.59 | 76.06 | 67.14 | 65.59 | 59.09 | 35.07 |
Showing 100 of 297 rows