| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Classification | DermaMNIST | Accuracy86.2 | 39 | |
| Image Classification | DermaMNIST (test) | L1 ECEKDE0.366 | 32 | |
| Medical Image Classification | DermaMNIST | AUC93.7 | 31 | |
| Medical Image Classification | DermaMNIST m=5 synthetic annotators, K=7, mean agreement 64.7% (test) | ECE2.06 | 26 | |
| Calibration | DermaMNIST (test) | Brier Score2.32 | 19 | |
| Multi-label Classification | DermaMNIST (test) | Macro AUC91.83 | 16 | |
| Image Classification | DermaMNIST (val) | Accuracy79.26 | 12 | |
| Medical Image Classification | DermaMNIST v2 (test) | AUCOC91.35 | 11 | |
| Classification | DermaMNIST Linear Evaluation 100% ratio | Accuracy85.14 | 7 | |
| Classification | DermaMNIST 10% ratio Linear Evaluation | Accuracy79.1 | 7 | |
| Classification | DermaMNIST Linear Evaluation 1% ratio | Accuracy70.87 | 7 | |
| Image Classification | DermaMNIST Retained v2 (test) | Accuracy91.41 | 3 | |
| Image Classification | DermaMNIST v2 (test) | Accuracy79.74 | 3 | |
| Image Classification | DermaMNIST | AUC0.937 | 3 | |
| Multi-Instance Learning Classification | DermaMNIST v2 (test) | Metric- | 0 |