Commonsense Reasoning on ARC-E
96.4Accuracy
Self-consistency
Updated 2d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2022.03 | 96.4 | - | - | |
2022.03 | 96 | - | - | |
2022.03 | 95.3 | - | - | |
2022.03 | 94 | - | - | |
2024.06 | 86.68 | 9.43 | 0.56 | |
2024.06 | 86.55 | 12.07 | 0.9 | |
2022.03 | 86.4 | - | - | |
2024.06 | 86.21 | 12.2 | 1 | |
2026.01 | 85.91 | 5.3 | 0.38 | |
2024.06 | 85.86 | 12.28 | 0.91 | |
2024.06 | 85.65 | 13.12 | 1.17 | |
2024.06 | 85.56 | 3.64 | 0.4 | |
2026.01 | 85.56 | 3.64 | 0.4 | |
2026.01 | 85.4 | 3.4 | 0.41 | |
2026.01 | 85.2 | 8.9 | 0.54 | |
2026.01 | 85.2 | 8.9 | 0.54 | |
2026.01 | 85.2 | 4.7 | 0.43 | |
2026.01 | 85.1 | 8.8 | 0.52 | |
2026.02 | 85 | - | - | |
2026.01 | 84.8 | 4.2 | 0.44 | |
2024.06 | 84.74 | 6.16 | 0.46 | |
2024.06 | 84.4 | 12.57 | 0.82 | |
2024.06 | 80.05 | 33.29 | 0.88 | |
2022.03 | 79.3 | - | - | |
2026.01 | 77 | 12.28 | 0.91 | |
2022.03 | 75.3 | - | - | |
2025.02 | 73.39 | - | - | |
2025.02 | 73.23 | - | - | |
2025.02 | 72.78 | - | - | |
2025.02 | 72.63 | - | - | |
2022.03 | 72.1 | - | - | |
2025.02 | 71.99 | - | - | |
2025.02 | 71.91 | - | - | |
2025.02 | 71.17 | - | - | |
2026.02 | 71 | - | - | |
2025.02 | 70.8 | - | - | |
2025.02 | 70.61 | - | - | |
2025.02 | 70.49 | - | - | |
2026.02 | 70 | - | - | |
2022.03 | 69.8 | - | - | |
2025.02 | 69.61 | - | - | |
2025.02 | 69.58 | - | - | |
2025.02 | 69.17 | - | - | |
2025.02 | 68.87 | - | - | |
2025.02 | 68.13 | - | - | |
2026.02 | 68 | - | - | |
2022.03 | 63.1 | - | - | |
2022.03 | 61.6 | - | - | |
2025.05 | 57.7 | - | - | |
2025.05 | 57.15 | - | - | |
2026.01 | 51.14 | - | - | |
2026.01 | 48.48 | - | - | |
2026.01 | 39.98 | - | - | |
2026.01 | 36.66 | - | - | |
2026.01 | 31.02 | - | - | |
2026.01 | 30.22 | - | - | |
2026.01 | 29.63 | - | - | |
2026.01 | 29.04 | - | - | |
2026.01 | 29 | - | - | |
2026.01 | 28.83 | - | - | |
2026.01 | 28.66 | - | - | |
2026.01 | 28.62 | - | - |