F-MNIST
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Classification | F-MNIST (test) | Accuracy96 | 64 | |
| Image Classification | F-MNIST | Accuracy92.8 | 39 | |
| Conformal Prediction | F-MNIST | Average Prediction Set Size1.7 | 24 | |
| Differentially Private Image Synthesis | F-MNIST | FID11.6 | 16 | |
| INR classification | F-MNIST Implicit Neural Representations (test) | Accuracy84.6 | 15 | |
| Image Classification | F-MNIST IDN-50% (test) | Accuracy76.43 | 12 | |
| Image Classification | F-MNIST IDN-40% (test) | Accuracy85.81 | 12 | |
| Image Classification | F-MNIST IDN-30% (test) | Accuracy89.61 | 12 | |
| Image Classification | F-MNIST IDN-20% (test) | Accuracy90.83 | 12 | |
| Image Classification | F-MNIST IDN-10% (test) | Accuracy91.96 | 12 | |
| One-class classification | f-MNIST (test) | AUC95.8 | 12 | |
| Dimensionality Reduction | F-MNIST | Triplet Centroid Accuracy92.5 | 10 | |
| Classification under DBA attack | F-MNIST | Balance Accuracy96.74 | 7 | |
| Accuracy Prediction | F-MNIST (test) | MSE2.94 | 6 | |
| Model Stealing | F-MNIST | Agreement69.6 | 6 | |
| Classification | F-MNIST unlabeled 2 (train) | Accuracy96 | 5 | |
| Classification | F-MNIST unlabeled 1 (train) | Accuracy95.41 | 5 | |
| Hierarchical Clustering | F-MNIST (test) | DP0.52 | 5 | |
| Dimensionality Reduction | F-MNIST | Trustworthiness99.2 | 5 | |
| One-Class Novelty Detection | F-MNIST | AUROC95 | 5 | |
| One-class classification | f-MNIST | AUC95.8 | 5 | |
| Dimension Reduction | F-MNIST 70000x784 | Runtime (s)65 | 5 | |
| Class Prior Estimation | F-MNIST-2 unlabeled (train) | Absolute Estimation Error0.02 | 4 | |
| Class Prior Estimation | F-MNIST unlabeled 1 (train) | Absolute Estimation Error0.014 | 4 | |
| Image Classification | F-MNIST Original (test) | Accuracy91.55 | 4 |
Showing 25 of 34 rows