Natural Language Understanding on ARC Easy
78.3Accuracy
Arcana
Updated 13d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.10 | 78.3 | - | |
2024.10 | 72.8 | - | |
2026.05 | 72.77 | 77.9 | |
2024.10 | 71.6 | - | |
2026.05 | 71.6 | - | |
2026.05 | 71 | - | |
2026.05 | 70.3 | - | |
2026.05 | 69.8 | - | |
2026.05 | 68.5 | - | |
2026.05 | 67.5 | - | |
2026.05 | 67.4 | - | |
2026.05 | 67.3 | - | |
2026.05 | 67 | - | |
2026.05 | 66.6 | - | |
2026.05 | 66.1 | - | |
2026.05 | 66 | - | |
2026.05 | 64.9 | - | |
2026.05 | 62.25 | 53.07 | |
2024.10 | 59.6 | - | |
2026.05 | 56.5 | - | |
2024.10 | 56.1 | - | |
2024.11 | 55.18 | - | |
2024.11 | 55.09 | - | |
2024.11 | 54.84 | - | |
2024.11 | 54.59 | - | |
2024.11 | 54.5 | - | |
2024.11 | 54.38 | - | |
2024.11 | 54.17 | - | |
2024.11 | 54.12 | - | |
2024.11 | 54.04 | - | |
2024.11 | 53.87 | - | |
2024.11 | 53.87 | - | |
2024.11 | 53.66 | - | |
2024.11 | 53.66 | - | |
2024.11 | 53.54 | - | |
2024.11 | 52.86 | - |