Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DermaMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Medical Image ClassificationDermaMNIST
Accuracy83.6
63
Image ClassificationDermaMNIST
Accuracy86.2
39
Image ClassificationDermaMNIST (test)
L1 ECEKDE0.366
32
Medical Image ClassificationDermaMNIST m=5 synthetic annotators, K=7, mean agreement 64.7% (test)
ECE2.06
26
CalibrationDermaMNIST (test)
Brier Score2.32
19
Multi-label ClassificationDermaMNIST (test)
Macro AUC91.83
16
Image ClassificationDermaMNIST (val)
Accuracy79.26
12
Medical Image ClassificationDermaMNIST v2 (test)
AUCOC91.35
11
Medical Image ClassificationDermaMNIST 40% Noise
Sensitivity98.7
10
Medical Image ClassificationDermaMNIST 20% Noise
Sensitivity97.7
10
Medical Image ClassificationDermaMNIST 0% Noise
Sensitivity97.7
10
Image ClassificationDermaMNIST Mild Non-IID alpha=1.0
Accuracy74.32
8
Image ClassificationDermaMNIST 7-class (test)
Accuracy73.46
8
Open-Set RecognitionDermaMNIST v=2 (test)
Accuracy86.82
7
ClassificationDermaMNIST Linear Evaluation 100% ratio
Accuracy85.14
7
ClassificationDermaMNIST 10% ratio Linear Evaluation
Accuracy79.1
7
ClassificationDermaMNIST Linear Evaluation 1% ratio
Accuracy70.87
7
Model Editingdermamnist
Δ Accuracy (pp)0.3
6
Machine UnlearningDermaMNIST 50% removal binary (test)
Specificity87
5
Machine UnlearningDermaMNIST 20% removal binary (test)
Specificity90
5
Image ClassificationDermaMNIST Retained v2 (test)
Accuracy91.41
3
Image ClassificationDermaMNIST v2 (test)
Accuracy79.74
3
Image ClassificationDermaMNIST
AUC0.937
3
ClassificationDermaMNIST
C.Acc83.39
2
Learning to DeferDermaMNIST Specialist
Accuracy76.59
2
Showing 25 of 26 rows