Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DermaMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationDermaMNIST
Accuracy86.2
39
Image ClassificationDermaMNIST (test)
L1 ECEKDE0.366
32
Medical Image ClassificationDermaMNIST
AUC93.7
31
Medical Image ClassificationDermaMNIST m=5 synthetic annotators, K=7, mean agreement 64.7% (test)
ECE2.06
26
CalibrationDermaMNIST (test)
Brier Score2.32
19
Multi-label ClassificationDermaMNIST (test)
Macro AUC91.83
16
Image ClassificationDermaMNIST (val)
Accuracy79.26
12
Medical Image ClassificationDermaMNIST v2 (test)
AUCOC91.35
11
ClassificationDermaMNIST Linear Evaluation 100% ratio
Accuracy85.14
7
ClassificationDermaMNIST 10% ratio Linear Evaluation
Accuracy79.1
7
ClassificationDermaMNIST Linear Evaluation 1% ratio
Accuracy70.87
7
Image ClassificationDermaMNIST Retained v2 (test)
Accuracy91.41
3
Image ClassificationDermaMNIST v2 (test)
Accuracy79.74
3
Image ClassificationDermaMNIST
AUC0.937
3
Multi-Instance Learning ClassificationDermaMNIST v2 (test)
Metric-
0
Showing 15 of 15 rows