GPQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | GPQA | Accuracy84.2 | 258 | |
| Science Reasoning | GPQA | Accuracy95.1 | 243 | |
| Graduate-level Question Answering | GPQA | Accuracy96.9 | 224 | |
| Reasoning | GPQA Diamond | Accuracy91.9 | 185 | |
| Graduate-level Science Reasoning | GPQA | Accuracy82.34 | 138 | |
| Scientific Question Answering | GPQA Diamond | Accuracy84.4 | 131 | |
| Scientific Reasoning | GPQA Main | Accuracy67.97 | 115 | |
| General Reasoning | Super GPQA | Accuracy71.1 | 99 | |
| Question Answering | GPQA Diamond | Accuracy68.4 | 97 | |
| Scientific Reasoning | GPQA Diamond | Accuracy74.24 | 94 | |
| Reasoning | GPQA | Accuracy71.43 | 92 | |
| Reasoning | GPQA | Pass@190.1 | 92 | |
| Scientific Reasoning | GPQA Diamond (test) | Accuracy99.37 | 88 | |
| Science Question Answering | GPQA | pass@1 Accuracy87.6 | 85 | |
| Science Question Answering | GPQA Diamond | Accuracy91.9 | 84 | |
| Scientific Reasoning | GPQA-D | Accuracy (%)66.2 | 77 | |
| Scientific Reasoning | GPQA | Accuracy70.2 | 75 | |
| Scientific Reasoning | GPQA Diamond | Accuracy80.13 | 73 | |
| Science Reasoning | GPQA | Accuracy (GPQA)59.22 | 72 | |
| Graduate-level Science Question Answering | GPQA | Accuracy (GPQA)61.95 | 72 | |
| Science Reasoning | GPQA Diamond | Accuracy83 | 72 | |
| Science Question Answering | GPQA | Accuracy63.51 | 69 | |
| Science Question Answering | GPQA | Accuracy55.8 | 69 | |
| Scientific Reasoning | GPQA Diamond | Score73.2 | 68 | |
| Scientific Reasoning | GPQA Diamond | Pass@1 Accuracy78.66 | 67 |
Showing 25 of 559 rows
...