GPQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | GPQA | Accuracy84.2 | 258 | |
| Science Reasoning | GPQA | Accuracy95.1 | 243 | |
| Graduate-level Question Answering | GPQA | Accuracy96.9 | 184 | |
| Reasoning | GPQA Diamond | Accuracy91.9 | 135 | |
| Question Answering | GPQA Diamond | Accuracy68.4 | 97 | |
| General Reasoning | Super GPQA | Accuracy71.1 | 89 | |
| Science Question Answering | GPQA | pass@1 Accuracy87.6 | 85 | |
| Scientific Reasoning | GPQA | Accuracy70.2 | 75 | |
| Scientific Reasoning | GPQA Diamond | Score73.2 | 68 | |
| Scientific Reasoning | GPQA Main | Accuracy43.08 | 67 | |
| Scientific Question Answering | GPQA Diamond | Accuracy84.4 | 64 | |
| Closed-ended reasoning | GPQA Diamond (test) | Accuracy65.9 | 63 | |
| Science Question Answering | GPQA main (test) | Exact Match Accuracy40.85 | 60 | |
| Reasoning | GPQA | Accuracy59.4 | 57 | |
| Scientific Reasoning | GPQA | Accuracy83.8 | 55 | |
| Question Answering | GPQA (test) | Accuracy45.5 | 55 | |
| Scientific Reasoning | GPQA Diamond | Pass@1 Accuracy66.8 | 54 | |
| Knowledge | GPQA | Accuracy90.4 | 51 | |
| Science Reasoning | GPQA | Pass@170.2 | 50 | |
| Question Answering | GPQA Diamond | Pass@175.7 | 49 | |
| Scientific Reasoning | GPQA Diamond | Accuracy87.5 | 48 | |
| General Reasoning | GPQA Diamond | Pass@1 Accuracy86.4 | 47 | |
| Science Question Answering | GPQA | Accuracy91.5 | 46 | |
| Science Question Answering | GPQA | Accuracy34.8 | 46 | |
| Science Question Answering | GPQA | Accuracy54.5 | 42 |
Showing 25 of 322 rows
...