SuperGPQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Scientific Reasoning | SuperGPQA | Mean@150.1 | 34 | |
| General Knowledge | SuperGPQA | pass@148.2 | 19 | |
| Multiple Choice Question Answering | SuperGPQA MCQA | Accuracy63.83 | 18 | |
| Reasoning | SuperGPQA | Pass@138.4 | 17 | |
| Question Answering | SuperGPQA (test) | Accuracy40.2 | 15 | |
| Scientific Reasoning | SuperGPQA | Accuracy44.7 | 15 | |
| Graduate-level Reasoning | SuperGPQA | Pass@136 | 14 | |
| LLM Routing | SUPERGPQA (val) | Top-1 Acc0.776 | 14 | |
| LLM Routing | SUPERGPQA | Top-1 Acc77.6 | 14 | |
| Medical Question Answering | SuperGPQA Clinical | Accuracy35.71 | 12 | |
| Question Answering | SuperGPQA Law | Accuracy43.8 | 10 | |
| Question Answering | SuperGPQA | Pass@134.51 | 8 | |
| Science Question Answering | SuperGPQA | Score35.59 | 8 | |
| Medical Question Answering | SuperGPQA | Accuracy27.66 | 8 | |
| Scientific Reasoning | SuperGPQA Sci | Accuracy50.25 | 8 | |
| Medical Reasoning | SuperGPQA Med | Accuracy0.3831 | 8 | |
| Scientific Reasoning | SuperGPQA Eng | Accuracy45 | 8 | |
| Scientific Reasoning | SuperGPQA | avg@356.8 | 6 | |
| Examination | SuperGPQA | Score50.38 | 5 | |
| Medical Question Answering | SuperGPQA Med | Pass@172.45 | 4 | |
| General Knowledge | SuperGPQA (test) | Accuracy18.6 | 4 | |
| Graduate-level Reasoning | SuperGPQA | Accuracy33.6 | 3 |
Showing 22 of 22 rows