MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classification
About
We introduce MedMNIST v2, a large-scale MNIST-like dataset collection of standardized biomedical images, including 12 datasets for 2D and 6 datasets for 3D. All images are pre-processed into a small size of 28x28 (2D) or 28x28x28 (3D) with the corresponding classification labels so that no background knowledge is required for users. Covering primary data modalities in biomedical images, MedMNIST v2 is designed to perform classification on lightweight 2D and 3D images with various dataset scales (from 100 to 100,000) and diverse tasks (binary/multi-class, ordinal regression, and multi-label). The resulting dataset, consisting of 708,069 2D images and 10,214 3D images in total, could support numerous research / educational purposes in biomedical image analysis, computer vision, and machine learning. We benchmark several baseline methods on MedMNIST v2, including 2D / 3D neural networks and open-source / commercial AutoML tools. The data and code are publicly available at https://medmnist.com/.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Classification | PneumoniaMNIST | Accuracy94.6 | 84 | |
| Classification | RetinaMNIST | ACC53.1 | 46 | |
| Medical Image Classification | PathMNIST | Accuracy91.1 | 42 | |
| 3D Image Classification | MedMNIST 3D v2 (test) | Organ Accuracy0.996 | 36 | |
| Image Classification | OrgancMnist MedMnist (test) | Accuracy92 | 33 | |
| Classification | PneumoniaMNIST MedMNIST v2 (test) | Accuracy94.6 | 32 | |
| Medical Image Classification | DermaMNIST | AUC92 | 31 | |
| Image Classification | OrganSMNIST v2 (test) | Accuracy81.3 | 31 | |
| Medical Image Classification | OCTMNIST | Accuracy77.6 | 28 | |
| Medical Image Classification | ChestMNIST | Accuracy94.8 | 22 |