Zero-shot Reasoning on Reasoning Suite (PIQA, HellaSwag, WinoGrande, ARC-e, ARC-c) (val test)
81.77PIQA
Dense
Updated 4d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2024.06 | 81.77 | 64.84 | 74.51 | 84.22 | 57.34 | 72.54 | |
2025.06 | 80.52 | 79.36 | 72.3 | 77.53 | 49.23 | 71.79 | |
2025.06 | 80.52 | 79.36 | 72.3 | 77.53 | 49.23 | 71.79 | |
2026.02 | 80.47 | 79.39 | 72.22 | 77.48 | 49.23 | 71.76 | |
2024.06 | 79.71 | 60.19 | 72.61 | 80.09 | 50.34 | 68.59 | |
2025.05 | 79.7 | 60.2 | 72.6 | 80.1 | 50.4 | 68.6 | |
2026.02 | 79.22 | 76.92 | 66.46 | 62.16 | 42.66 | 65.48 | |
2025.06 | 79.11 | 75.99 | 68.82 | 74.58 | 46.25 | 68.95 | |
2026.02 | 79.11 | 75.99 | 69.06 | 74.58 | 46.25 | 69 | |
2026.02 | 79.11 | 75.99 | 69.06 | 74.58 | 46.25 | 69 | |
2025.06 | 78.18 | 74.11 | 69.85 | 72.77 | 46.33 | 68.25 | |
2024.06 | 78.02 | 57.17 | 68.43 | 76.3 | 43.51 | 64.69 | |
2025.06 | 77.58 | 74.29 | 70.24 | 74.16 | 45.56 | 68.37 | |
2025.06 | 77.58 | 73.43 | 70.48 | 73.19 | 44.97 | 67.93 | |
2025.06 | 77.53 | 73.94 | 70.88 | 73.23 | 44.8 | 68.07 | |
2026.02 | 77.48 | 72.18 | 68.27 | 72.98 | 42.75 | 66.73 | |
2026.02 | 77.48 | 67.13 | 61.88 | 65.78 | 38.48 | 62.15 | |
2026.02 | 77.2 | 68.07 | 66.3 | 70.45 | 42.92 | 64.99 | |
2026.02 | 77.09 | 71.3 | 66.3 | 71.36 | 41.89 | 65.59 | |
2025.06 | 76.93 | 74.77 | 69.61 | 70.12 | 47.61 | 67.81 | |
2026.02 | 76.93 | 72.2 | 66.3 | 65.82 | 41.38 | 64.53 | |
2025.06 | 76.82 | 69.88 | 65.19 | 61.83 | 35.75 | 61.89 | |
2025.06 | 76.77 | 71.71 | 70.56 | 73.4 | 45.05 | 67.5 | |
2026.02 | 76.66 | 66.13 | 61.17 | 64.86 | 37.88 | 61.34 | |
2025.06 | 76.5 | 71.19 | 70.32 | 73.32 | 44.45 | 67.16 | |
2024.06 | 76.49 | 52.69 | 64.48 | 67.76 | 36.77 | 59.64 | |
2025.06 | 76.44 | 68.41 | 64.96 | 62.25 | 36.6 | 61.73 | |
2025.06 | 76.39 | 66.78 | 60.7 | 63.47 | 38.14 | 61.1 | |
2025.06 | 76.39 | 70.2 | 66.3 | 68.01 | 42.32 | 64.64 | |
2026.02 | 76.33 | 73.44 | 71.11 | 72.1 | 44.54 | 67.5 | |
2025.05 | 76.28 | 54.3 | 71.27 | 75.84 | 43.9 | 64.32 | |
2025.06 | 76.22 | 68.27 | 63.61 | 58.71 | 36.52 | 60.67 | |
2026.02 | 76.22 | 69.59 | 68.19 | 71.71 | 41.89 | 65.52 | |
2025.05 | 76.17 | 54.92 | 72.14 | 76.18 | 43.94 | 64.67 | |
2025.05 | 76.1 | 54.2 | 71.7 | 75.7 | 43.6 | 64.26 | |
2025.06 | 76.06 | 67.14 | 65.59 | 59.09 | 35.07 | 60.59 | |
2024.06 | 76.01 | 51.8 | 64.33 | 67.93 | 36.86 | 59.39 | |
2025.05 | 75.7 | 54 | 72.2 | 75.8 | 43.8 | 64.3 | |
2024.06 | 75.68 | 49.94 | 62.35 | 64.9 | 36.6 | 57.89 | |
2024.06 | 75.03 | 49.69 | 62.19 | 67.34 | 32.25 | 57.3 | |
2025.06 | 75.03 | 66.42 | 66.06 | 70.03 | 38.48 | 63.2 | |
2026.02 | 74.97 | 73.01 | 68.75 | 67.4 | 45.05 | 66.24 | |
2025.06 | 74.71 | 66.12 | 67.17 | 71.38 | 41.04 | 64.1 | |
2024.06 | 74.7 | 64.29 | 61.96 | 57.49 | 36.69 | 59.03 | |
2024.06 | 74.64 | 46.93 | 60.22 | 66.16 | 34.13 | 56.42 | |
2026.02 | 74.59 | 70.74 | 67.4 | 64.44 | 41.98 | 63.83 | |
2024.06 | 74.48 | 46.62 | 63.69 | 65.7 | 34.3 | 56.96 | |
2025.06 | 74.37 | 66.91 | 67.4 | 62.88 | 36.69 | 61.65 | |
2026.02 | 74.21 | 65.87 | 62.43 | 61.07 | 37.29 | 60.17 | |
2024.06 | 74.1 | 46.61 | 58.17 | 64.31 | 33.62 | 55.36 | |
2025.06 | 73.94 | 69.72 | 67.4 | 68.35 | 41.98 | 64.28 | |
2024.06 | 73.88 | 50.08 | 62.19 | 67.09 | 34.47 | 57.54 | |
2025.06 | 73.83 | 63.92 | 68.35 | 65.61 | 39.25 | 62.19 | |
2026.02 | 73.72 | 66.8 | 66.61 | 66.12 | 41.98 | 63.05 | |
2025.06 | 73.67 | 62.99 | 63.3 | 61.95 | 33.62 | 59.1 | |
2025.06 | 73.56 | 69.4 | 63.3 | 61.83 | 40.27 | 61.67 | |
2026.02 | 73.07 | 62.47 | 58.96 | 56.48 | 33.02 | 56.8 | |
2025.05 | 72.91 | 46.45 | 69.14 | 67.34 | 36.01 | 58.37 | |
2024.06 | 72.74 | 45.75 | 55.72 | 61.36 | 31.06 | 53.33 | |
2026.02 | 72.74 | 68.45 | 66.54 | 63.43 | 41.3 | 62.49 | |
2026.02 | 72.74 | 67.8 | 70.8 | 60.35 | 41.3 | 62.6 | |
2026.02 | 72.42 | 60.44 | 59.27 | 54.34 | 34.56 | 56.21 | |
2024.06 | 72.36 | 45.1 | 58.8 | 59.64 | 30.03 | 53.19 | |
2025.05 | 72.2 | 45.6 | 68 | 69.7 | 35.2 | 58.14 | |
2025.05 | 72.1 | 47.7 | 68.5 | 70.3 | 38 | 59.22 | |
2025.05 | 72.03 | 46.03 | 68.51 | 69.91 | 36.18 | 58.53 | |
2024.06 | 71.87 | 45.17 | 59.51 | 66.5 | 36.52 | 55.91 | |
2026.02 | 71.71 | 59.31 | 55.56 | 53.7 | 33.28 | 54.71 | |
2024.06 | 71.54 | 40.71 | 55.4 | 62.16 | 28.92 | 51.75 | |
2025.06 | 71.27 | 58.42 | 59.67 | 52.15 | 33.62 | 55.03 | |
2024.06 | 70.84 | 44.11 | 59.43 | 62.96 | 34.04 | 54.28 | |
2024.06 | 70.56 | 41.09 | 59.98 | 59.97 | 29.01 | 52.12 | |
2024.06 | 70.4 | 42.73 | 52.72 | 57.24 | 29.95 | 50.61 | |
2026.02 | 70.4 | 56.35 | 58.64 | 46.89 | 32.85 | 53.03 | |
2024.06 | 70.29 | 40.45 | 53.04 | 53.03 | 27.3 | 48.82 | |
2024.06 | 70.29 | 56.47 | 60.06 | 53.2 | 34.81 | 54.97 | |
2026.02 | 70.24 | 62.63 | 65.9 | 56.06 | 36.09 | 58.18 | |
2026.02 | 69.75 | 58.09 | 61.48 | 58.08 | 33.02 | 56.08 | |
2024.06 | 69.58 | 41.52 | 57.77 | 53.99 | 28.58 | 50.29 | |
2024.06 | 69.58 | 39.47 | 53.98 | 57.24 | 28.67 | 49.79 | |
2026.02 | 69.53 | 58.87 | 62.12 | 43.6 | 32.17 | 53.26 | |
2026.02 | 69.42 | 61.5 | 64.33 | 56.27 | 35.24 | 57.35 | |
2025.05 | 68.72 | 40.03 | 62.51 | 61.95 | 30.2 | 52.68 | |
2025.06 | 68.72 | 60.65 | 58.64 | 53.03 | 30.72 | 54.35 | |
2024.06 | 68.61 | 40.8 | 56.67 | 54.8 | 27.82 | 49.74 | |
2026.02 | 68.39 | 62.89 | 59.27 | 56.99 | 37.46 | 57 | |
2026.02 | 68.34 | 54.08 | 60.46 | 55.39 | 35.84 | 54.82 | |
2026.02 | 68.28 | 51.5 | 58.56 | 52.9 | 28.5 | 51.95 | |
2025.06 | 68.12 | 54.19 | 65.98 | 54.34 | 32.76 | 55.08 | |
2024.06 | 68.01 | 38.75 | 52.64 | 52.36 | 26.28 | 47.61 | |
2024.06 | 67.95 | 35.81 | 53.12 | 53.91 | 26.36 | 47.43 | |
2025.06 | 67.85 | 52.58 | 62.43 | 61.87 | 33.7 | 55.69 | |
2026.02 | 67.36 | 42 | 49.88 | 54.17 | 28.58 | 48.4 | |
2024.06 | 67.3 | 35.47 | 51.93 | 48.23 | 21.84 | 44.95 | |
2025.06 | 67.25 | 56.98 | 67.64 | 62.92 | 39.51 | 58.86 | |
2024.06 | 67.08 | 35.84 | 54.38 | 53.54 | 26.45 | 47.46 | |
2024.06 | 67.03 | 36.42 | 52.41 | 50.17 | 24.15 | 46.04 | |
2024.06 | 66.7 | 40.16 | 54.3 | 49.83 | 26.53 | 47.5 | |
2025.06 | 65.78 | 53.04 | 62.98 | 56.1 | 35.15 | 54.61 | |
2024.06 | 65.29 | 56.77 | 60.06 | 42.68 | 31.74 | 51.31 |
Showing 100 of 119 rows