Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Graph ClassificationCMNIST-75sp unbiased (test)
Accuracy82.73
60
Image ClassificationCMNIST (test)
Test Accuracy93.54
55
Image ClassificationCMNIST 0.5% bias ratio unbiased (test)
Accuracy97.52
17
Graph ClassificationCMNIST color
Accuracy36.37
17
Graph ClassificationCMNIST-sp Superpixel distribution shift
Accuracy68.94
15
Graph ClassificationCMNIST color GOOD
Accuracy53.3
14
Graph ClassificationCMNIST GraphOOD (test)
Accuracy52.17
13
Graph ClassificationCMNIST
Accuracy28.49
13
Graph ClassificationCMNIST-SP
Accuracy62.13
12
Image ClassificationCMNIST 5% bias ratio unbiased (test)
Accuracy98.13
11
Image ClassificationCMNIST 2% bias ratio unbiased (test)
Accuracy97.15
11
Image ClassificationCMNIST 1% bias ratio unbiased (test)
Accuracy95.35
11
Graph ClassificationCMNIST correlation shift (test)
Accuracy49.73
10
Image ClassificationCMNIST original unshifted
Worst Accuracy73.6
9
Domain AdaptationCMNIST v1 (test)
Accuracy (Shift 1.0)100
9
Graph ClassificationCMNIST (test)
Accuracy69
8
Image ClassificationCMNIST In-distribution
Accuracy99.5
7
Unsupervised DisentanglementCMNIST (test)
DCI0.948
7
Biased Feature UnlearningCMNIST (D_t)
Accuracy98.49
6
Biased Feature UnlearningCMNIST Du (unlearn)
Accuracy98.88
6
Biased Feature UnlearningCMNIST Dr split (retain)
Accuracy98.76
6
Image ClassificationCMNIST (test)
Accuracy (Noise 0.1)88.4
6
Image ClassificationShifted CMNIST
Worst Accuracy71.8
5
Showing 23 of 23 rows