GPQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | GPQA | Accuracy84.2 | 258 | |
| Science Reasoning | GPQA | Accuracy95.1 | 243 | |
| Graduate-level Question Answering | GPQA | Accuracy96.9 | 215 | |
| Reasoning | GPQA Diamond | Accuracy91.9 | 185 | |
| Scientific Question Answering | GPQA Diamond | Accuracy84.4 | 123 | |
| Graduate-level Science Reasoning | GPQA | Accuracy82.34 | 121 | |
| Scientific Reasoning | GPQA Main | Accuracy43.08 | 101 | |
| General Reasoning | Super GPQA | Accuracy71.1 | 99 | |
| Question Answering | GPQA Diamond | Accuracy68.4 | 97 | |
| Reasoning | GPQA | Accuracy59.4 | 88 | |
| Science Question Answering | GPQA | pass@1 Accuracy87.6 | 85 | |
| Scientific Reasoning | GPQA Diamond (test) | Accuracy99.37 | 82 | |
| Scientific Reasoning | GPQA-D | Accuracy (%)66.2 | 77 | |
| Scientific Reasoning | GPQA | Accuracy70.2 | 75 | |
| Science Reasoning | GPQA | Accuracy (GPQA)59.22 | 72 | |
| Graduate-level Science Question Answering | GPQA | Accuracy (GPQA)61.95 | 72 | |
| Science Question Answering | GPQA | Accuracy63.51 | 69 | |
| Science Question Answering | GPQA | Accuracy55.8 | 69 | |
| Scientific Reasoning | GPQA Diamond | Score73.2 | 68 | |
| Scientific Reasoning | GPQA Diamond | Pass@1 Accuracy78.66 | 67 | |
| Question Answering | GPQA (test) | Accuracy70.4 | 65 | |
| Closed-ended reasoning | GPQA Diamond (test) | Accuracy65.9 | 63 | |
| Scientific Reasoning | GPQA Diamond | Accuracy80.13 | 62 | |
| Question Answering | GPQA Diamond | Accuracy84 | 61 | |
| Science Question Answering | GPQA main (test) | Exact Match Accuracy40.85 | 60 |
Showing 25 of 475 rows
...