| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MedMCQA | ProtRLSearch | Accuracy90.4 | 591 | 24d ago | |
| MedQA | Spurious Universal | Accuracy89.41 | 179 | 1mo ago | |
| MedQA | ToolTree | Accuracy93.88 | 153 | 3mo ago | |
| MedQA | Med-PaLM 2 | Accuracy86.5 | 145 | 1mo ago | |
| MedMCQA (test) | Accuracy84.13 | 134 | 4mo ago | ||
| PubMedQA | HuatuoGPT-o1-70B | Accuracy81.4 | 122 | 1mo ago | |
| MMLU Med | SEMA-RAG | Accuracy92.1 | 111 | 1mo ago | |
| MedBullets | Multi-Agent Medical Decision Consensus Matrix System | Accuracy84.2 | 81 | 22d ago | |
| MedExpQA | Overall Accuracy86.19 | 70 | 4mo ago | ||
| HeadQA | Zero-Shot CoT | Accuracy92.2 | 65 | 1mo ago | |
| PubMedQA | SafeLoRA | Accuracy82.8 | 65 | 2mo ago | |
| BioASQ | SEMA-RAG | Accuracy88.67 | 63 | 2mo ago | |
| MedMCQA | Llama-3.1-8B-Instruct | BLEU Score10.82 | 54 | 4mo ago | |
| MedQA US | SEMA-RAG | Accuracy90.42 | 43 | 2mo ago | |
| DDXPlus | Multi-Agent Medical Decision Consensus Matrix System | Accuracy86.5 | 43 | 4mo ago | |
| MediQ offline (test) | SkeMex | Accuracy97.64 | 38 | 1mo ago | |
| HealthBench Medicine N=5,000 (overall) | RVPO (k=0.5→2.0 / 1.0→2.0) | Rubric Score26.1 | 36 | 2mo ago | |
| MedicalQA | Symphony-Coord | Accuracy86 | 33 | 4mo ago | |
| PubMedQA | MedXIAOHE | Pass@186 | 32 | 1mo ago | |
| MedXpertQA | MA-RAG-ext | Accuracy22.2 | 31 | 3mo ago | |
| Medec | BFRS | Accuracy69.2 | 30 | 3mo ago | |
| MedCalc-Bench | Zero-Shot CoT | Accuracy35.3 | 30 | 3mo ago | |
| MedQA | HCQR | Decision-Useful Rate89.8 | 30 | 4mo ago | |
| Polish Board Certification Examinations | Average Score69.2 | 30 | 4mo ago | ||
| MMLU-P | GPT-4.1-mini | Accuracy97.1 | 29 | 4mo ago |
