ARC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | ARC Challenge | Accuracy96.3 | 906 | |
| Question Answering | ARC Easy | Accuracy98.2 | 597 | |
| Question Answering | ARC-E | Accuracy95.23 | 416 | |
| Question Answering | ARC Easy | Normalized Acc96.4 | 389 | |
| Science Question Answering | ARC Challenge | Accuracy96 | 342 | |
| Question Answering | ARC | Accuracy94.6 | 230 | |
| Science Question Answering | ARC-C | Accuracy96.3 | 193 | |
| Question Answering | ARC-C | Accuracy94.1 | 192 | |
| Commonsense Reasoning | ARC Challenge | Accuracy93.8 | 190 | |
| Multiple Choice Question Answering | ARC Easy | Accuracy99.7 | 188 | |
| Reasoning | ARC Easy | Accuracy96.63 | 187 | |
| Science Question Answering | ARC-E | Accuracy97.53 | 184 | |
| Commonsense Reasoning | ARC-C | Accuracy96.3 | 172 | |
| Science Question Answering | ARC Easy | Accuracy98 | 155 | |
| Question Answering | ARC Challenge | Accuracy (ARC)87.3 | 142 | |
| Multiple-choice Question Answering | ARC Challenge | Acc74.7 | 118 | |
| Commonsense Reasoning | ARC-E | Accuracy96.4 | 106 | |
| Scientific Reasoning | ARC Challenge | Accuracy92.5 | 94 | |
| Reasoning | ARC | Accuracy92.34 | 94 | |
| Reasoning | ARC Challenge | Accuracy97.2 | 93 | |
| Question Answering | ARC-C | Accuracy0.71 | 87 | |
| Question Answering | ARC Challenge | Normalized Accuracy59 | 86 | |
| Reasoning | ARC-c | Accuracy90.36 | 80 | |
| Question Answering | ARC Challenge (val) | Accuracy93.3 | 76 | |
| Question Answering | ARC Challenge (test) | Accuracy91.2 | 73 |
Showing 25 of 272 rows
...