MedQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Question Answering | MedQA | Accuracy89.41 | 179 | |
| Medical Question Answering | MedQA | Accuracy93.88 | 153 | |
| Medical Question Answering | MedQA | Accuracy86.5 | 145 | |
| Question Answering | MedQA-USMLE (test) | Accuracy94.34 | 101 | |
| Question Answering | MedQA | Accuracy94.8 | 96 | |
| Question Answering | MedQA | Accuracy71.72 | 86 | |
| Question Answering | MedQA (test) | Accuracy89.55 | 67 | |
| Medical Reasoning | MedQA | Accuracy92.8 | 61 | |
| Question Answering | MedQA | F1 Score (%)72 | 50 | |
| Medical Question Answering | MedQA US | Accuracy90.42 | 43 | |
| Question Answering | MedQA | EM Accuracy55.6 | 42 | |
| Multiple Choice Question Answering | MedQA | Accuracy50.98 | 39 | |
| Question Answering | MedQA standard (test) | Accuracy94 | 32 | |
| Multi-Turn Medical Dialogue | MedQA | Accuracy68.69 | 32 | |
| Medical Reasoning | MedQA | Accuracy83.76 | 30 | |
| Speculative Decoding | MedQA | Match Rate (MAT)6.47 | 30 | |
| Medical Question Answering | MedQA | Decision-Useful Rate89.8 | 30 | |
| Clinical Question Answering | MedQA | Accuracy94.2 | 30 | |
| Question Answering | MedQA | Accuracy85.8 | 28 | |
| Medical Question Answering | MedQA (test) | Accuracy92 | 28 | |
| Medical Question Answering | MedQA | Accuracy78.3 | 27 | |
| Question Answering | MedQA USMLE | Accuracy87.4 | 27 | |
| Multiple Choice Question Answering | MedQA 5 opts | Accuracy87 | 26 | |
| Medical Diagnosis | MedQA agent | Rounds9.11 | 25 | |
| Question Answering | MedQA | Accuracy72.9 | 24 |
Showing 25 of 138 rows