Medical Report Generation

Benchmarks

Dataset Name	SOTA Method	Metric
MIMIC-CXR (test)	EIR	ROUGE-L0.415	100	2d ago
IU-Xray (test)	NeuroSymb-MRG (Ours)	ROUGE-L0.463	56	3mo ago
MIMIC-CXR	MedWriter	BLEU-40.164	43	3mo ago
IU X-Ray (test)	SGF	BLEU-421.5	41	1mo ago
MIMIC-CXR	TIF-GRPO	F1 Score70.8	34	13d ago
MIMIC-CXR	MedQwen	ROUGE-L25.69	28	2mo ago
Ultrasound Average	EchoVLM	BLEU-153.87	24	1mo ago
Ultrasound Kidney	EchoVLM	BLEU-177.56	24	1mo ago
Ultrasound Gynecology	EchoVLM	BLEU-152.52	24	1mo ago
Ultrasound Breast	EchoVLM	BLEU-171.36	24	1mo ago
MIMIC-CXR 2.0.0 (test)	SEI-1	BL-40.148	21	3mo ago
IU X-Ray	COMG	BLEU-10.536	21	3mo ago
IU-Xray	Fleming-VL-8B	ROUGE-L44.9	17	3mo ago
Open-i	MedWriter	CIDEr0.345	17	2mo ago
MIMIC-CXR	Lingshu-7B + Med-Scout	ROUGE-L31.4	15	3mo ago
Merlin (test)	Astra	RaTE Score35.64	14	2d ago
BIMCV n=1,505 cases (test)	Astra	RaTE Score0.2624	14	2d ago
Med-R2 (test)	Hulu-Med-7B	ROUGE-114.6	14	8d ago
DeepEyeNet	DREAM	BLEU-10.447	14	1mo ago
SpineBench		SIP4.55	14	2mo ago
Fetal Ultrasound Report Dataset	FetUSAgents	AC Score1.317	13	8d ago
CBCT Report Generation Chinese (ZH)	CBCTRepD	BLEU-148.3	13	2mo ago
Tuberculosis dataset	MedGemma + FF	F1 Score30.55	13	3mo ago
CTRG-Chest (external)	Astra	RaTE Score0.2434	12	2d ago
AMOS-MM-Report	Ours w/ TIF-GRPO	Precision25.32	12	13d ago

Showing 25 of 87 rows