Commonsense Reasoning on BoolQ, PIQA, SIQA, HellaS., WinoG., ARC-e, ARC-c, OBQA (test)
88BoolQ Accuracy
PaLM (540B)
Updated 3d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2024.05 | 88 | 82.3 | - | 83.4 | 81.1 | 76.6 | 53 | 53.4 | - | |
2025.07 | 78.13 | 90.48 | 82.14 | 96.62 | 88.24 | 95.2 | 87.71 | 91.2 | 88.72 | |
2025.07 | 77.61 | 91.51 | 82.4 | 96.93 | 90.37 | 96 | 88.74 | 92.8 | 89.55 | |
2024.07 | 76.9 | 91.4 | 82.1 | 96.7 | 86.9 | 89.6 | 79.4 | 86.1 | 85.9 | |
2024.05 | 75.8 | 86.9 | 81.2 | 94.4 | 87 | 89.6 | 77.9 | 85.2 | 84.8 | |
2025.07 | 75.72 | 90.21 | 81.42 | 95.31 | 89.11 | 93.1 | 82.76 | 88.2 | 86.98 | |
2025.05 | 75.63 | 88.85 | 80.35 | 95.64 | 86.11 | 91.16 | 80.89 | 86.4 | 85.63 | |
2025.07 | 75.44 | 89.72 | 81.78 | 95.58 | 87.69 | 92.89 | 84.3 | 90 | 87.17 | |
2024.07 | 75.3 | 88.9 | 82.2 | 94.9 | 86 | 89 | 79.8 | 84.9 | 85.3 | |
2026.04 | 75.26 | 91.05 | 82.55 | 95.81 | 90.21 | 95.44 | 85.62 | 89.6 | 88.19 | |
2026.04 | 75.17 | 88.74 | 77.58 | 95.21 | 89.11 | 92.93 | 84.73 | 88 | 86.43 | |
2024.06 | 75.1 | 86.4 | 76.7 | 75.4 | 83.3 | 90.4 | 79.1 | 85 | 81.4 | |
2024.06 | 75 | 89.7 | 81.1 | 95 | 83.3 | 91.2 | 80.5 | 85.8 | 85.2 | |
2025.07 | 74.95 | 89.34 | 80.3 | 95.52 | 85.64 | 90.66 | 79.52 | 85.8 | 85.22 | |
2024.06 | 74.8 | 86.7 | 79.9 | 93.9 | 85.1 | 90.2 | 79.3 | 84.2 | 84.2 | |
2025.07 | 74.77 | 89.12 | 79.63 | 95.84 | 86.35 | 91.08 | 80.72 | 85.2 | 85.34 | |
2024.05 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.02 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.06 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.06 | 74.6 | 89.7 | 81 | 95 | 85.8 | 90.5 | 81.5 | 86.8 | 85.6 | |
2025.05 | 74.56 | 88.52 | 80.09 | 95.17 | 86.74 | 90.19 | 79.78 | 84.6 | 84.96 | |
2025.05 | 74.53 | 88.52 | 80.04 | 95.45 | 85.32 | 89.73 | 78.92 | 84.2 | 84.59 | |
2024.05 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2024.02 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2024.06 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2025.05 | 74.46 | 88.14 | 81.37 | 94.81 | 85.08 | 89.18 | 80.72 | 86 | 84.97 | |
2025.03 | 74.4 | 89.12 | 81.37 | 95.55 | 86.66 | 92.97 | 83.19 | 88.8 | 86.51 | |
2024.05 | 74.3 | 88.1 | 81.8 | 95.1 | 87.3 | 91.1 | 81.7 | 87.2 | 85.8 | |
2025.07 | 73.94 | 88.36 | 80.25 | 95.85 | 85.95 | 91.04 | 80.55 | 85.8 | 85.22 | |
2024.07 | 73.8 | 88.2 | 80.4 | 94 | 85.5 | 87.5 | 78.1 | 84 | 83.9 | |
2025.05 | 73.76 | 87.11 | 79.84 | 94.72 | 84.29 | 89.98 | 79.61 | 84.6 | 84.24 | |
2025.07 | 73.73 | 88.74 | 80.96 | 95.63 | 87.92 | 90.45 | 77.82 | 86.6 | 85.23 | |
2026.04 | 73.73 | 84.6 | 81.27 | 92.33 | 86.82 | 88.24 | 77.21 | 87.4 | 83.95 | |
2026.03 | 73.6 | 87.4 | 81 | 95.2 | 86.5 | 90 | 79.8 | 85 | 84.8 | |
2026.04 | 73.6 | 84.4 | 80.2 | 91.5 | 84.5 | 84.7 | 72.1 | 81.2 | 81.53 | |
2026.04 | 73.6 | 83.95 | 80.5 | 87.12 | 85 | 87.79 | 76.88 | 87 | 82.73 | |
2026.04 | 73.49 | 90.44 | 79.19 | 95.03 | 90 | 93.79 | 84.73 | 88.67 | 86.92 | |
2026.04 | 73.49 | 89.5 | 79.99 | 94.6 | 89.9 | 93.18 | 84.3 | 89.4 | 86.79 | |
2024.07 | 73.4 | 83.4 | 82.1 | 88.3 | 84.9 | 86.6 | 66.7 | 82.5 | 81 | |
2024.05 | 73.3 | 85.6 | 80.8 | 91.6 | 85.5 | 84.2 | 73.7 | 83.3 | 82.3 | |
2024.08 | 73.3 | 86.4 | 82 | 94.4 | 86.1 | 87.4 | 74.1 | 87 | 83.8 | |
2025.03 | 73.27 | 88.25 | 78.92 | 94.96 | 87.21 | 90.95 | 77.99 | 86.2 | 84.72 | |
2024.05 | 73.2 | 85.4 | 82.1 | 93.4 | 85.1 | 87.8 | 73.3 | 84.4 | 83.1 | |
2024.08 | 73.2 | 85.5 | 82.4 | 94.5 | 86.3 | 86.8 | 74.6 | 86 | 83.7 | |
2026.03 | 73.2 | 84.5 | 81.9 | 90.8 | 85.5 | 84.6 | 71.5 | 82.9 | 81.8 | |
2025.05 | 73.18 | 85.31 | 74.36 | 86.57 | 74.19 | 90.95 | 80.29 | 84 | 81.11 | |
2026.04 | 73.15 | 83.68 | 80.09 | 74.57 | 85.95 | 87.33 | 72.53 | 86.2 | 80.43 | |
2024.07 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.05 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.02 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.08 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.07 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.07 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2026.03 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2026.04 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77.01 | |
2025.05 | 73.09 | 85.96 | 75.08 | 90.48 | 75.53 | 90.74 | 81.4 | 84.4 | 82.09 | |
2024.05 | 72.9 | 83 | 79.8 | 92.4 | 83 | 86.6 | 72 | 80.1 | 81.2 | |
2024.11 | 72.9 | 85.6 | 80.7 | 92 | 83.7 | 85.6 | 71.6 | 85.6 | 82.2 | |
2024.07 | 72.9 | 85.6 | 77.8 | 92.7 | 83.3 | 89.7 | 77.6 | 82.8 | 82.8 | |
2026.03 | 72.9 | 82.2 | 81.4 | 87.9 | 84 | 82.7 | 69.1 | 81.1 | 80.2 | |
2026.03 | 72.9 | 82 | 82.8 | 89.5 | 85.8 | 84.2 | 70.6 | 82 | 81.2 | |
2026.03 | 72.8 | 86.1 | 80.6 | 91 | 85.8 | 86 | 72.1 | 84 | 82.3 | |
2026.04 | 72.78 | 84.06 | 79.68 | 80.34 | 86.66 | 87.12 | 72.35 | 86 | 81.12 | |
2025.03 | 72.75 | 88.52 | 81.17 | 95.27 | 86.42 | 92.59 | 80.97 | 87.8 | 85.69 | |
2025.07 | 72.72 | 87.21 | 79.17 | 94.65 | 87.37 | 89.52 | 76.96 | 86 | 84.2 | |
2026.03 | 72.7 | 88.3 | 80.5 | 94.7 | 84.4 | 89.8 | 79.9 | 86.6 | 84.6 | |
2026.03 | 72.6 | 86 | 79.2 | 89.1 | 83.5 | 84.8 | 70.6 | 82.8 | 81.1 | |
2025.09 | 72.6 | 88.3 | 80.09 | 94.31 | 86.42 | 91.92 | 81.14 | 85.2 | 85 | |
| 72.5 | 84.8 | 79.8 | 92.1 | 84.7 | 84.2 | 71.2 | 82.4 | 81.5 | ||
2024.05 | 72.5 | 85.3 | 79.9 | 90.1 | 82.9 | 82.7 | 69.7 | 83.6 | 80.8 | |
2024.02 | 72.5 | 84.9 | 79.8 | 92.1 | 84.7 | 84.2 | 71.2 | 82.4 | 81.4 | |
2024.02 | 72.5 | 85.3 | 79.9 | 90.1 | 82.9 | 82.7 | 69.7 | 83.6 | 80.8 | |
2024.08 | 72.5 | 84.9 | 79.8 | 92.1 | 84.7 | 84.2 | 71.2 | 82.4 | 81.5 | |
2026.03 | 72.5 | 84.9 | 79.8 | 92.1 | 84.7 | 84.2 | 71.2 | 82.4 | 81.4 | |
2024.05 | 72.4 | 84.9 | 81.5 | 92.4 | 84.2 | 84.2 | 69.6 | 82.8 | 81.5 | |
2024.05 | 72.4 | 83.8 | 79.7 | 92.5 | 83.9 | 85.3 | 72.5 | 82.6 | 81.6 | |
2024.02 | 72.4 | 84.9 | 81.5 | 92.4 | 84.2 | 84.2 | 69.6 | 82.8 | 81.5 | |
2024.08 | 72.4 | 84.9 | 81.5 | 92.4 | 84.2 | 84.2 | 69.6 | 82.8 | 81.5 | |
2025.05 | 72.35 | 86.51 | 75.18 | 91.73 | 74.98 | 90.74 | 79.52 | 84 | 81.88 | |
2024.07 | 72.3 | 84.2 | 78.7 | 88.5 | 84 | 80.7 | 69.1 | 83.7 | 80.2 | |
2024.06 | 72.3 | 86.7 | 79.3 | 93.5 | 84.8 | 87.7 | 75.7 | 82.8 | 82.8 | |
2024.07 | 72.2 | 87.5 | 80 | 94.3 | 83.9 | 84.5 | 75.6 | 82.4 | 82.5 | |
2024.08 | 72.2 | 85.1 | 81.2 | 94.1 | 84.4 | 86.6 | 73.7 | 86.6 | 83 | |
2025.05 | 72.17 | 86.51 | 75.79 | 91.28 | 75.61 | 91.46 | 81.48 | 86 | 82.54 | |
2026.04 | 72.14 | 89.21 | 81.3 | 95.11 | 89.45 | 94.56 | 85.32 | 89 | 87.01 | |
2024.05 | 72.1 | 83.5 | 80.5 | 90.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.02 | 72.1 | 83.5 | 80.5 | 90.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.11 | 72.1 | 83.5 | 80.5 | 80.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.08 | 72.1 | 83.5 | 80.5 | 90.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.08 | 72.1 | 86.3 | 81.8 | 95.1 | 87.2 | 86.2 | 73.7 | 84.2 | 83.3 | |
2026.03 | 72.1 | 83.5 | 80.5 | 90.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2025.07 | 72.05 | 86.56 | 79.84 | 93.84 | 84.69 | 86.32 | 75.17 | 85 | 82.93 | |
2024.05 | 72 | 83.1 | 79.9 | 89.1 | 83 | 84.5 | 71 | 81.2 | 80.5 | |
2024.02 | 72 | 83.1 | 79.9 | 89.1 | 83 | 84.5 | 71 | 81.2 | 80.5 | |
2025.05 | 71.93 | 82.92 | 79.22 | 88.9 | 83.03 | 82.7 | 66.98 | 82 | 79.71 | |
2024.05 | 71.8 | 83 | 79.2 | 88.1 | 82.4 | 82.5 | 67.3 | 81.8 | 79.5 | |
2024.05 | 71.8 | 83.7 | 76 | 89.1 | 82.6 | 83.7 | 68.2 | 82.4 | 79.7 | |
2024.02 | 71.8 | 83 | 79.2 | 88.1 | 82.4 | 82.5 | 67.3 | 81.8 | 79.5 | |
2024.02 | 71.8 | 83.7 | 76 | 89.1 | 82.6 | 83.7 | 68.2 | 82.4 | 79.7 | |
2024.08 | 71.8 | 83 | 79.2 | 88.1 | 82.4 | 82.5 | 67.3 | 81.8 | 79.5 |
Showing 100 of 202 rows