SuperGPQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Scientific Reasoning | SuperGPQA | Mean@150.1 | 24 | |
| Question Answering | SuperGPQA (test) | Accuracy40.2 | 15 | |
| Scientific Reasoning | SuperGPQA | Accuracy44.7 | 15 | |
| LLM Routing | SUPERGPQA (val) | Top-1 Acc0.776 | 14 | |
| LLM Routing | SUPERGPQA | Top-1 Acc77.6 | 14 | |
| General Knowledge | SuperGPQA | pass@136.21 | 11 | |
| Question Answering | SuperGPQA Law | Accuracy43.8 | 10 | |
| Medical Question Answering | SuperGPQA | Accuracy27.66 | 8 | |
| Scientific Reasoning | SuperGPQA Sci | Accuracy50.25 | 8 | |
| Medical Reasoning | SuperGPQA Med | Accuracy0.3831 | 8 | |
| Scientific Reasoning | SuperGPQA Eng | Accuracy45 | 8 | |
| Scientific Reasoning | SuperGPQA | avg@356.8 | 6 | |
| Examination | SuperGPQA | Score50.38 | 5 | |
| Medical Question Answering | SuperGPQA Med | Pass@172.45 | 4 | |
| General Knowledge | SuperGPQA (test) | Accuracy18.6 | 4 | |
| Reasoning | SuperGPQA | Pass@130.2 | 3 |
Showing 16 of 16 rows