Medical Diagnosis

Benchmarks

Dataset Name	SOTA Method	Metric
MIMIC-IV diagnostic evaluation set (test)	GLEAN (N=3)	Accuracy78.33	54	3mo ago
agent-CMB	Medical-CoT*	Rounds18.34	25	3mo ago
MedQA agent	MedKGI	Rounds9.11	25	3mo ago
AgentClinic OOD original (test)	Aloe-Beta-70B	Similarity (Sim)0.684	20	23d ago
MedEinst Robust 1.0	ECR-Agent (Qwen3-32B)	Robust Accuracy24.21	18	3mo ago
MedEinst Baseline 1.0	ECR-Agent (Qwen3-32B)	Baseline Accuracy69.49	18	3mo ago
COVID19-CT	SH-PEFT	F1 Score83	16	3mo ago
MAU (test)	UMed-LVLM	DL Score53	13	3mo ago
PMC-Patients	MedExAgent-8B	Similarity Score62.6	12	23d ago
DDxPlus	MedExAgent-8B	Similarity96.6	12	23d ago
DDXPlus n=50	BMBE + GPT-5.4-nano	Top-1 Accuracy78	12	1mo ago
Step-CoT (test)	Ours (Teacher)	Accuracy78.3	10	2mo ago
CXR14 (external)		Precision for Edema71.26	10	3mo ago
MedAction 300 Hard		Diag. Acc.82	9	23d ago
MedR-Bench		Diagnostic Accuracy81	9	23d ago
DiagnosisArena (test)	GoS	Match (LLM-as-a-Judge)31.88	9	2mo ago
MediQ (test)		Average Outcome Reward74.67	9	2mo ago
NEJM	DDO	Rounds17.91	9	3mo ago
IndicMedDialog Telugu 1.0 (test)	GEMMA	Diagnostic Accuracy6.38	8	20d ago
IndicMedDialog Tamil 1.0 (test)	GEMMA	Diagnostic Accuracy11.91	8	20d ago
IndicMedDialog Assamese 1.0 (test)	Tiny-AYA	Diagnostic Accuracy8.08	8	20d ago
IndicMedDialog Punjabi 1.0 (test)	IndicMedLM	Diagnostic Accuracy20.42	8	20d ago
IndicMedDialog Gujarati 1.0 (test)	Tiny-AYA	Diagnostic Accuracy0.3702	8	20d ago
IndicMedDialog Urdu 1.0 (test)	IndicMedLM	Diagnostic Accuracy28.51	8	20d ago
IndicMedDialog Bengali 1.0 (test)	IndicMedLM	Diagnostic Accuracy58.72	8	20d ago

Showing 25 of 38 rows