NEJM
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Question Answering | NEJM | Accuracy73.13 | 16 | |
| Medical Diagnosis | NEJM | Rounds17.91 | 9 | |
| Medical Long-form Generation | NEJM (test) | SM Score76.6 | 8 | |
| Medical Reasoning | NEJM | Accuracy60.8 | 7 | |
| Medical Reasoning | NEJM (OOD) | Accuracy68.3 | 7 | |
| Medical Question Answering | NEJM (test) | Accuracy61.8 | 6 | |
| Multi-turn Clinical Simulation | NEJM Extension OOD (test) | Accuracy33.3 | 6 | |
| Multi-turn Clinical Simulation | NEJM OOD (test) | Accuracy46.7 | 6 | |
| Diagnostic Accuracy | NEJM 120 | Accuracy41.67 | 2 |
Showing 9 of 9 rows