medical QA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-choice Medical Question Answering | Medical QA Multi-choice | MMLU-Med Accuracy70.7 | 22 | |
| Medical Question Answering | Out-of-domain medical QA History, Engineering, Law (test) | History Accuracy50.4 | 10 | |
| Medical Question Answering | Medical QA | GPT-4 Score92.5 | 9 | |
| Medical Question Answering | Medical QA Primary n=319 (test) | UCCR21.94 | 8 | |
| Medical Question Answering | Medical QA Primary Split n = 314 (dev) | UCCR20.7 | 8 | |
| Medical Question Answering | Medical QA offline evaluation | Honesty0.83 | 3 |
Showing 6 of 6 rows