ARC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | ARC Challenge | Accuracy96.3 | 906 | |
| Question Answering | ARC Challenge | Accuracy (ARC)87.3 | 598 | |
| Question Answering | ARC Easy | Accuracy98.2 | 597 | |
| Question Answering | ARC-E | Accuracy95.23 | 523 | |
| Question Answering | ARC Easy | Normalized Acc96.4 | 391 | |
| Science Question Answering | ARC Challenge | Accuracy96 | 354 | |
| Science Question Answering | ARC-C | Accuracy96.3 | 261 | |
| Question Answering | ARC-C | Accuracy94.1 | 258 | |
| Multiple Choice Question Answering | ARC Easy | Accuracy99.7 | 257 | |
| Reasoning | ARC | Accuracy94.5 | 245 | |
| Commonsense Reasoning | ARC Challenge | Accuracy93.8 | 243 | |
| Science Question Answering | ARC-E | Accuracy97.53 | 240 | |
| Reasoning | ARC Easy | Accuracy96.63 | 233 | |
| Question Answering | ARC | Accuracy94.6 | 230 | |
| Commonsense Reasoning | ARC-C | Accuracy96.3 | 215 | |
| Question Answering | ARC Easy | Accuracy90.48 | 210 | |
| Science Question Answering | ARC Easy | Accuracy98 | 162 | |
| Question Answering | ARC (test) | Accuracy90.5 | 153 | |
| Commonsense Reasoning | ARC-E | Accuracy96.4 | 152 | |
| Multiple-choice Question Answering | ARC Challenge | Acc74.7 | 133 | |
| Question Answering | ARC-C | Accuracy0.71 | 116 | |
| Scientific Reasoning | ARC Challenge | Accuracy92.5 | 115 | |
| Reasoning | ARC-c | Accuracy90.85 | 112 | |
| Science Question Answering | ARC Challenge | Accuracy93 | 108 | |
| Question Answering | ARC Challenge | Normalized Accuracy59 | 105 |
Showing 25 of 418 rows
...