Question Answering and Commonsense Reasoning on LM Eval ARCC, ARCE, HellaSwag, PIQA (test)
61.6ARCC
Meta 'FP8'
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2024.06 | 61.6 | 81.4 | 67.1 | 83.8 | |
2024.06 | 61.5 | 81.4 | 66.8 | 83.5 | |
2024.06 | 61.3 | 80.9 | 66.7 | 84.2 | |
2024.06 | 60.7 | 81.1 | 65.4 | 82.2 | |
2024.06 | 56.7 | 75.6 | 61.5 | 82.8 | |
2024.06 | 56.3 | 75.8 | 61.4 | 83 | |
2024.06 | 55.1 | 75.1 | 60.8 | 82.6 | |
2024.06 | 54.4 | 72.6 | 59.4 | 82.5 | |
2024.06 | 52.7 | 72.2 | 60.2 | 82.6 | |
2024.06 | 51.6 | 77.8 | 57.7 | 80 | |
2024.06 | 50.7 | 78 | 57.5 | 80.1 | |
2024.06 | 50.4 | 77.7 | 56.9 | 79.3 | |
2024.06 | 46.2 | 75.4 | 54.4 | 78.7 | |
2024.06 | 45.1 | 75.6 | 54.5 | 79 | |
2024.06 | 43.5 | 74.3 | 51.9 | 75.1 | |
2024.06 | 43.3 | 74.3 | 52.2 | 75.7 | |
2024.06 | 36 | 68.5 | 45.2 | 74.2 | |
2024.06 | 34.8 | 68.4 | 44.5 | 73.3 |