Commonsense Reasoning on BoolQ, PIQA, SIQA, HellaS., WinoG., ARC-e, ARC-c, OBQA (test)
88BoolQ Accuracy
PaLM (540B)
Updated 3d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2024.05 | 88 | 82.3 | - | 83.4 | 81.1 | 76.6 | 53 | 53.4 | - | |
2025.07 | 78.13 | 90.48 | 82.14 | 96.62 | 88.24 | 95.2 | 87.71 | 91.2 | 88.72 | |
2025.07 | 77.61 | 91.51 | 82.4 | 96.93 | 90.37 | 96 | 88.74 | 92.8 | 89.55 | |
2024.07 | 76.9 | 91.4 | 82.1 | 96.7 | 86.9 | 89.6 | 79.4 | 86.1 | 85.9 | |
2024.05 | 75.8 | 86.9 | 81.2 | 94.4 | 87 | 89.6 | 77.9 | 85.2 | 84.8 | |
2025.07 | 75.72 | 90.21 | 81.42 | 95.31 | 89.11 | 93.1 | 82.76 | 88.2 | 86.98 | |
2025.07 | 75.44 | 89.72 | 81.78 | 95.58 | 87.69 | 92.89 | 84.3 | 90 | 87.17 | |
2024.07 | 75.3 | 88.9 | 82.2 | 94.9 | 86 | 89 | 79.8 | 84.9 | 85.3 | |
2024.06 | 75.1 | 86.4 | 76.7 | 75.4 | 83.3 | 90.4 | 79.1 | 85 | 81.4 | |
2024.06 | 75 | 89.7 | 81.1 | 95 | 83.3 | 91.2 | 80.5 | 85.8 | 85.2 | |
2025.07 | 74.95 | 89.34 | 80.3 | 95.52 | 85.64 | 90.66 | 79.52 | 85.8 | 85.22 | |
2024.06 | 74.8 | 86.7 | 79.9 | 93.9 | 85.1 | 90.2 | 79.3 | 84.2 | 84.2 | |
2025.07 | 74.77 | 89.12 | 79.63 | 95.84 | 86.35 | 91.08 | 80.72 | 85.2 | 85.34 | |
2024.05 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.02 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.06 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.06 | 74.6 | 89.7 | 81 | 95 | 85.8 | 90.5 | 81.5 | 86.8 | 85.6 | |
2024.05 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2024.02 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2024.06 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2025.03 | 74.4 | 89.12 | 81.37 | 95.55 | 86.66 | 92.97 | 83.19 | 88.8 | 86.51 | |
2024.05 | 74.3 | 88.1 | 81.8 | 95.1 | 87.3 | 91.1 | 81.7 | 87.2 | 85.8 | |
2025.07 | 73.94 | 88.36 | 80.25 | 95.85 | 85.95 | 91.04 | 80.55 | 85.8 | 85.22 | |
2024.07 | 73.8 | 88.2 | 80.4 | 94 | 85.5 | 87.5 | 78.1 | 84 | 83.9 | |
2025.07 | 73.73 | 88.74 | 80.96 | 95.63 | 87.92 | 90.45 | 77.82 | 86.6 | 85.23 | |
2024.07 | 73.4 | 83.4 | 82.1 | 88.3 | 84.9 | 86.6 | 66.7 | 82.5 | 81 | |
2024.05 | 73.3 | 85.6 | 80.8 | 91.6 | 85.5 | 84.2 | 73.7 | 83.3 | 82.3 | |
2024.08 | 73.3 | 86.4 | 82 | 94.4 | 86.1 | 87.4 | 74.1 | 87 | 83.8 | |
2025.03 | 73.27 | 88.25 | 78.92 | 94.96 | 87.21 | 90.95 | 77.99 | 86.2 | 84.72 | |
2024.05 | 73.2 | 85.4 | 82.1 | 93.4 | 85.1 | 87.8 | 73.3 | 84.4 | 83.1 | |
2024.08 | 73.2 | 85.5 | 82.4 | 94.5 | 86.3 | 86.8 | 74.6 | 86 | 83.7 | |
2025.05 | 73.18 | 85.31 | 74.36 | 86.57 | 74.19 | 90.95 | 80.29 | 84 | 81.11 | |
2024.07 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.05 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.02 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.08 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.07 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2024.07 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77 | |
2025.05 | 73.09 | 85.96 | 75.08 | 90.48 | 75.53 | 90.74 | 81.4 | 84.4 | 82.09 | |
2024.05 | 72.9 | 83 | 79.8 | 92.4 | 83 | 86.6 | 72 | 80.1 | 81.2 | |
2024.11 | 72.9 | 85.6 | 80.7 | 92 | 83.7 | 85.6 | 71.6 | 85.6 | 82.2 | |
2024.07 | 72.9 | 85.6 | 77.8 | 92.7 | 83.3 | 89.7 | 77.6 | 82.8 | 82.8 | |
2025.03 | 72.75 | 88.52 | 81.17 | 95.27 | 86.42 | 92.59 | 80.97 | 87.8 | 85.69 | |
2025.07 | 72.72 | 87.21 | 79.17 | 94.65 | 87.37 | 89.52 | 76.96 | 86 | 84.2 | |
| 72.5 | 84.8 | 79.8 | 92.1 | 84.7 | 84.2 | 71.2 | 82.4 | 81.5 | ||
2024.05 | 72.5 | 85.3 | 79.9 | 90.1 | 82.9 | 82.7 | 69.7 | 83.6 | 80.8 | |
2024.02 | 72.5 | 84.9 | 79.8 | 92.1 | 84.7 | 84.2 | 71.2 | 82.4 | 81.4 | |
2024.02 | 72.5 | 85.3 | 79.9 | 90.1 | 82.9 | 82.7 | 69.7 | 83.6 | 80.8 | |
2024.08 | 72.5 | 84.9 | 79.8 | 92.1 | 84.7 | 84.2 | 71.2 | 82.4 | 81.5 | |
2024.05 | 72.4 | 84.9 | 81.5 | 92.4 | 84.2 | 84.2 | 69.6 | 82.8 | 81.5 | |
2024.05 | 72.4 | 83.8 | 79.7 | 92.5 | 83.9 | 85.3 | 72.5 | 82.6 | 81.6 | |
2024.02 | 72.4 | 84.9 | 81.5 | 92.4 | 84.2 | 84.2 | 69.6 | 82.8 | 81.5 | |
2024.08 | 72.4 | 84.9 | 81.5 | 92.4 | 84.2 | 84.2 | 69.6 | 82.8 | 81.5 | |
2025.05 | 72.35 | 86.51 | 75.18 | 91.73 | 74.98 | 90.74 | 79.52 | 84 | 81.88 | |
2024.07 | 72.3 | 84.2 | 78.7 | 88.5 | 84 | 80.7 | 69.1 | 83.7 | 80.2 | |
2024.06 | 72.3 | 86.7 | 79.3 | 93.5 | 84.8 | 87.7 | 75.7 | 82.8 | 82.8 | |
2024.07 | 72.2 | 87.5 | 80 | 94.3 | 83.9 | 84.5 | 75.6 | 82.4 | 82.5 | |
2024.08 | 72.2 | 85.1 | 81.2 | 94.1 | 84.4 | 86.6 | 73.7 | 86.6 | 83 | |
2025.05 | 72.17 | 86.51 | 75.79 | 91.28 | 75.61 | 91.46 | 81.48 | 86 | 82.54 | |
2024.05 | 72.1 | 83.5 | 80.5 | 90.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.02 | 72.1 | 83.5 | 80.5 | 90.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.11 | 72.1 | 83.5 | 80.5 | 80.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.08 | 72.1 | 83.5 | 80.5 | 90.5 | 83.7 | 82.8 | 68.3 | 82.4 | 80.5 | |
2024.08 | 72.1 | 86.3 | 81.8 | 95.1 | 87.2 | 86.2 | 73.7 | 84.2 | 83.3 | |
2025.07 | 72.05 | 86.56 | 79.84 | 93.84 | 84.69 | 86.32 | 75.17 | 85 | 82.93 | |
2024.05 | 72 | 83.1 | 79.9 | 89.1 | 83 | 84.5 | 71 | 81.2 | 80.5 | |
2024.02 | 72 | 83.1 | 79.9 | 89.1 | 83 | 84.5 | 71 | 81.2 | 80.5 | |
2024.05 | 71.8 | 83 | 79.2 | 88.1 | 82.4 | 82.5 | 67.3 | 81.8 | 79.5 | |
2024.05 | 71.8 | 83.7 | 76 | 89.1 | 82.6 | 83.7 | 68.2 | 82.4 | 79.7 | |
2024.02 | 71.8 | 83 | 79.2 | 88.1 | 82.4 | 82.5 | 67.3 | 81.8 | 79.5 | |
2024.02 | 71.8 | 83.7 | 76 | 89.1 | 82.6 | 83.7 | 68.2 | 82.4 | 79.7 | |
2024.08 | 71.8 | 83 | 79.2 | 88.1 | 82.4 | 82.5 | 67.3 | 81.8 | 79.5 | |
2025.03 | 71.62 | 84.71 | 78.86 | 93.19 | 82.4 | 85.98 | 71.08 | 84.8 | 81.58 | |
2024.05 | 71.6 | 83 | 79.7 | 91.8 | 81.8 | 84 | 68.3 | 82.1 | 80.3 | |
2025.03 | 71.31 | 85.36 | 79.83 | 92.97 | 83.43 | 87.12 | 74.15 | 84 | 82.27 | |
2024.05 | 71.3 | 82.1 | 78.6 | 90.2 | 79 | 82.9 | 67.2 | 76.8 | 78.5 | |
2025.05 | 71.22 | 86.02 | 75.38 | 90.27 | 74.19 | 89.9 | 79.44 | 84 | 81.3 | |
2025.07 | 71.16 | 86.18 | 79.58 | 93.97 | 84.61 | 87.29 | 75.09 | 83.6 | 82.68 | |
2025.03 | 71.04 | 83.41 | 80.14 | 93.4 | 84.21 | 85.48 | 71.33 | 83 | 81.5 | |
2024.07 | 71 | 81.4 | 79.6 | 87.4 | 83.2 | 82.6 | 67.5 | 81.5 | 79.3 | |
2025.05 | 70.83 | 84.44 | 73.34 | 90.63 | 74.11 | 90.87 | 80.12 | 81.8 | 80.77 | |
2024.05 | 70.8 | 85.2 | 79.9 | 91.7 | 84.3 | 84.2 | 71.2 | 79 | 80.8 | |
2024.02 | 70.8 | 85.2 | 79.9 | 91.7 | 84.3 | 84.2 | 71.2 | 79 | 80.8 | |
2024.07 | 70.8 | 85.2 | 79.9 | 91.7 | 84.3 | 84.2 | 71.2 | 79 | 80.8 | |
2025.03 | 70.61 | 83.95 | 80.09 | 93.27 | 82.79 | 85.9 | 70.99 | 82 | 81.2 | |
2024.08 | 70.6 | 83.2 | 79 | 92.3 | 81.8 | 84.2 | 70.6 | 80 | 80.2 | |
2025.03 | 70.52 | 82.69 | 79.11 | 92 | 83.74 | 84.42 | 68.94 | 82.8 | 80.53 | |
2024.08 | 70.4 | 81.9 | 79 | 91.4 | 80.3 | 84 | 68.7 | 77.8 | 79.2 | |
2024.08 | 70.3 | 82.6 | 79.2 | 92 | 81.8 | 84.8 | 68.8 | 82.2 | 80.2 | |
2024.05 | 70 | 82.6 | 79.7 | 83.2 | 80.6 | 80.6 | 65.4 | 77.6 | 77.5 | |
2024.02 | 70 | 82.6 | 79.7 | 83.2 | 80.6 | 80.6 | 65.4 | 77.6 | 77.5 | |
2025.07 | 69.85 | 85.85 | 79.53 | 92 | 82.95 | 85.1 | 70.73 | 81 | 80.88 | |
2024.05 | 69.8 | 79.9 | 79.5 | 83.6 | 82.6 | 79.8 | 64.7 | 81 | 77.6 | |
2024.02 | 69.8 | 79.9 | 79.5 | 83.6 | 82.6 | 79.8 | 64.7 | 81 | 77.6 | |
2024.05 | 69.7 | 83.4 | 78.6 | 87.2 | 81 | 81.9 | 66.2 | 79.2 | 78.4 | |
2024.02 | 69.7 | 83.4 | 78.6 | 87.2 | 81 | 81.9 | 66.2 | 79.2 | 78.4 | |
2024.08 | 69.3 | 84.4 | 80.3 | 93.1 | 84.2 | 83.2 | 68.2 | 78.9 | 80.2 | |
2024.11 | 69.1 | 82.8 | 78.9 | 84.8 | 80.7 | 80.9 | 65.8 | 79.2 | 77.8 | |
2024.08 | 69 | 82 | 78.5 | 90.9 | 78.9 | 83 | 68.2 | 76.4 | 78.4 | |
2024.07 | 68.9 | 81 | 77.4 | 87.5 | 81.3 | 81.1 | 62.8 | 79.9 | 77.5 |
Showing 100 of 138 rows