ColorMNIST
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Color Classification | ColorMNIST | Adversarial Accuracy100 | 30 | |
| Digit Classification | ColorMNIST | Adversarial Accuracy100 | 30 | |
| Image Classification | ColorMNIST (ρ = 80%) (test) | Average Accuracy76.6 | 20 | |
| Classification | ColorMNIST (OOD) | Accuracy73.8 | 16 | |
| Classification | ColorMNIST (ID) | Accuracy100 | 16 | |
| Image Classification | ColorMNIST reversed (test) | Accuracy50.93 | 13 | |
| Generative Modeling | ColorMNIST | MSE206 | 10 | |
| Image Classification | ColorMNIST (ρ = 80%) | Average Accuracy76.6 | 7 | |
| Image Classification | ColorMNIST (test) | Accuracy89.9 | 6 | |
| Compositional Generalization | ColorMNIST 40 OOD compositions (Generalization) | FID84.7 | 5 | |
| Compositional Generalization | ColorMNIST Faithfulness 40 OOD compositions | FID62.6 | 5 | |
| Task Prediction | ColorMNIST+ | Task Accuracy99.7 | 5 | |
| Concept Prediction | ColorMNIST+ | Concept Accuracy99.2 | 4 |
Showing 13 of 13 rows