Zero-shot Accuracy on Downstream Suite (BoolQ, HellaSwag, PIQA, RACE, WinoGrande)
82.4BoolQ Accuracy
Baseline
Updated 3d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2024.10 | 82.4 | 60.2 | 79.5 | 46.8 | 71.9 | 68.2 | |
2024.10 | 79.2 | 57.1 | 78.1 | 44 | 69.5 | 65.6 | |
2024.10 | 78.9 | 59.9 | 80 | 46.4 | 72.8 | 67.6 | |
2024.10 | 78.3 | 60.5 | 79.5 | 43 | 72.8 | 66.8 | |
2024.10 | 78.3 | 62.1 | 81.1 | 47 | 75.2 | 68.7 | |
2024.10 | 78.2 | 57.9 | 78 | 43.7 | 70.6 | 65.7 | |
2024.10 | 77.9 | 57 | 77.8 | 42.4 | 69.9 | 65 | |
2024.10 | 77.1 | 57.1 | 78.7 | 42.7 | 69.2 | 65 | |
2024.10 | 76.6 | 57.3 | 79.5 | 40.2 | 70.2 | 64.8 | |
2024.10 | 76.4 | 57.2 | 79.3 | 40.7 | 70.5 | 64.8 | |
2024.10 | 75.7 | 56.2 | 78 | 41.5 | 69.1 | 64.1 | |
2024.10 | 72.2 | 55.8 | 79.3 | 40.1 | 69.7 | 63.4 | |
2024.10 | 72.2 | 52 | 76.5 | 38 | 63.5 | 60.4 | |
2024.10 | 70.3 | 55.3 | 78.9 | 40.7 | 69.3 | 62.9 | |
2024.10 | 69 | 54.2 | 78.1 | 41.4 | 67.8 | 62.1 | |
2024.10 | 66.6 | 45.1 | 73 | 36.4 | 63.9 | 55.6 | |
2024.10 | 66.5 | 52.3 | 77.6 | 38.9 | 66.9 | 60.4 | |
2024.10 | 64.3 | 43.5 | 74.2 | 37.6 | 58.1 | 55.5 | |
2024.10 | 62.3 | 39.9 | 71.6 | 34.5 | 58.7 | 53.4 |