| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MedMCQA | ReConcile | Accuracy86 | 72 | 25d ago | |
| MedQA | ReConcile | Accuracy92.8 | 61 | 25d ago | |
| Professional Medicine | Majority Vote | Accuracy74.6 | 56 | 4mo ago | |
| PubMedQA | ReLAR | Accuracy79.23 | 48 | 18d ago | |
| HealthBench Hard | Accuracy40.74 | 41 | 1mo ago | ||
| Medicine MedQA M-Med | Search-o1 | MedQA Score75.2 | 40 | 2mo ago | |
| MedJourney offline (test) | SkeMex | Accuracy81.44 | 38 | 1mo ago | |
| DDXPlus | DMoA | Accuracy (DDXPlus)83.37 | 36 | 2mo ago | |
| HealthBench | COTCAgent | Accuracy70.41 | 36 | 2mo ago | |
| DiSCQ | COTCAgent | Accuracy98.37 | 30 | 2mo ago | |
| Time-MMD | COTCAgent | Accuracy85.33 | 30 | 2mo ago | |
| MedQA | COTCAgent | Accuracy83.76 | 30 | 2mo ago | |
| MedCaseReasoning (test) | Accuracy72.5 | 28 | 3mo ago | ||
| MedDDx (test) | MedLA+LLaMA3.1(8B) | Basic Accuracy48.2 | 28 | 4mo ago | |
| Medical Reasoning Evaluation Suite m23k | TEMP | Average Performance57.5 | 25 | 29d ago | |
| MedDDx | MedLA+LLaMA3.1(8B) | Basic Accuracy48.2 | 22 | 4mo ago | |
| XMEMRs | RE-MCDF | Recall42.33 | 22 | 4mo ago | |
| NEEMRs | RE-MCDF | Recall46.13 | 22 | 4mo ago | |
| MedXpertQA | Accuracy42.9 | 20 | 22d ago | ||
| Medicine MedBullets, MedXQA | LLaMA3.2-3B-Instruct (Full-shot) | Accuracy (MedBullets)84.87 | 18 | 3mo ago | |
| MMLU Pro | MDAgents | Accuracy80.7 | 18 | 29d ago | |
| Medbullets, MedMCQA, MedQA | + WIST (Reward) | MedBullets Score54.22 | 15 | 4mo ago | |
| MedXpert | MedVerse | Accuracy19.3 | 14 | 29d ago | |
| RareDis Sub (test) | Llama-3.1-8B-Instruct + MedSSR | Symptoms Accuracy80 | 13 | 3mo ago | |
| MedBullets | MDAgents | Accuracy80.8 | 13 | 3mo ago |
