Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Derm7pt

Benchmarks

Task NameDataset NameSOTA ResultTrend
Medical ClassificationDerm7pt
Accuracy84.69
48
Skin lesion recognitionDerm7pt
mAP76.7
20
Dermoscopy Image Classification and Concept PredictionDerm7pt asymmetric filtering (test)
Label Accuracy85
19
Concept PredictionDerm7pt symmetric filtering (test)
Concept Accuracy70
19
Label ClassificationDerm7pt symmetric filtering (test)
Accuracy90
19
Concept PredictionDerm7pt
Accuracy86
18
Diagnostic Classificationderm7pt Melanoma vs. Atypical Nevus (test)
Accuracy77.6
15
Skin Lesion ClassificationDerm7pt
Expected Calibration Error (ECE)2.2
15
Skin lesion diagnostic classificationDerm7pt (In-distribution)
Accuracy70.89
12
Skin Lesion Classificationderm7pt clinical (out-of-distribution)
ROC AUC0.7396
12
Skin Lesion Classificationderm7pt dermoscopic (out-of-distribution)
ROC AUC0.8369
12
Diagnosis classificationDerm7pt (test)
F177.3
12
Concept AnnotationDerm7pt
F1-Macro65.06
11
Concept AnnotationDerm7pt (test)
AUROC69
11
Multimodal Skin Lesion ClassificationDerm7pt (test)
Sensitivity (SEN)79.87
9
Skin disease diagnosisDerm7pt 1.0 (test)
AUC89.48
9
ClassificationDerm7pt
AUC88.6
8
ClassificationDerm7pt (test)
AUC90.1
8
Multimodal DiagnosisDerm7pt
Parameters28.47
6
Skin Cancer Image RetrievalDerm7pt (5-fold cross-val)
mAP (Fold 1)83.8
5
RetrievalDerm7pt
Top-1 Accuracy79.3
5
Melanoma inferenceDerm7pt (test)
BA (t=1)69.1
5
7-point criteria classificationDerm7pt (test)
BA (PN)68.6
5
Medical Image ClassificationDerm7pt (test)
Accuracy92.29
4
Concept RetrievalDerm7pt
P@10 (Streaks)100
3
Showing 25 of 26 rows