Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MEDIC

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationMEDIC (In-Domain)
Top-1 Accuracy (Damage Severity)81.39
12
CR label predictionMEDIC
Accuracy82.9
5
ER label predictionMEDIC
Accuracy82.2
5
EE label predictionMEDIC
Accuracy88.3
5
Medical Note SummarizationMEDIC Note Summ
Kendall's tau_b-0.275
3
Medical GenerationMEDIC ACI Bench
Kendall's tau_b0.341
3
Open-Ended Medical EvaluationMEDIC Open-Ended
Kendall's tau_b0.485
3
Medical Safety EvaluationMEDIC MedSafety
Kendall's tau_b0.552
3
Medical Chat EvaluationMEDIC HealthBench
Kendall's Tau-b0.546
3
ClassificationMEDIC OOD Evaluation
Top-1 Accuracy (DS)80.98
2
Showing 10 of 10 rows