Zero-shot Evaluation Suite (ARC, BOOLQ, PIQA, WINO)
60.5ARCC
BF16
Updated 4d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2024.06 | 60.5 | 86.9 | 85.3 | 82.4 | 80.3 | |
2024.06 | 56.1 | 83.9 | 85.8 | 81.3 | 80.6 | |
2024.06 | 50.2 | 80.1 | 81 | 79.7 | 72.9 | |
2024.06 | 50.2 | 79.7 | 81.3 | 79.7 | 73.1 | |
2024.06 | 50.2 | 79.6 | 79.5 | 79.4 | 73.4 | |
2024.06 | 49.2 | 79.3 | 80 | 79.2 | 74.5 | |
2024.06 | 48.6 | 77.8 | 85 | 77.8 | 79.7 | |
2024.06 | 46.4 | 77.4 | 79.9 | 77.9 | 72.9 | |
2024.06 | 44.2 | 75.2 | 76.7 | 77.6 | 70.7 | |
2024.06 | 39.2 | 72.9 | 76.6 | 75.6 | 68.2 | |
2024.06 | 35 | 67.3 | 84.7 | 71.9 | 76.7 | |
2024.06 | 31.1 | 36.6 | 85.7 | 58.8 | 76.4 | |
2024.06 | 28 | 35.2 | 83.6 | 57.1 | 72.6 | |
2024.06 | 18.3 | 32.2 | 82.1 | 54.7 | 68.9 |