Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CMNIST

Benchmarks

Task NameDataset NameSOTA ResultTrend
Graph ClassificationCMNIST-75sp unbiased (test)
Accuracy82.73
60
Image ClassificationCMNIST (test)
Test Accuracy93.54
55
Image ClassificationCMNIST 0.5% bias ratio unbiased (test)
Accuracy97.52
17
Graph ClassificationCMNIST color
Accuracy36.37
17
Graph ClassificationCMNIST-sp Superpixel distribution shift
Accuracy68.94
15
Graph ClassificationCMNIST color OOD
Accuracy48.1
14
Graph ClassificationCMNIST color ID
Accuracy79.3
14
Graph ClassificationCMNIST color GOOD
Accuracy53.3
14
Graph ClassificationCMNIST GraphOOD (test)
Accuracy52.17
13
Graph ClassificationCMNIST
Accuracy28.49
13
Graph ClassificationCMNIST-SP
Accuracy62.13
12
Image ClassificationCMNIST 5% bias ratio unbiased (test)
Accuracy98.13
11
Image ClassificationCMNIST 2% bias ratio unbiased (test)
Accuracy97.15
11
Image ClassificationCMNIST 1% bias ratio unbiased (test)
Accuracy95.35
11
Graph ClassificationCMNIST correlation shift (test)
Accuracy49.73
10
Image ClassificationCMNIST original unshifted
Worst Accuracy73.6
9
Domain AdaptationCMNIST v1 (test)
Accuracy (Shift 1.0)100
9
Graph ClassificationCMNIST (test)
Accuracy69
8
Image ClassificationCMNIST In-distribution
Accuracy99.5
7
Unsupervised DisentanglementCMNIST (test)
DCI0.948
7
Biased Feature UnlearningCMNIST (D_t)
Accuracy98.49
6
Biased Feature UnlearningCMNIST Du (unlearn)
Accuracy98.88
6
Biased Feature UnlearningCMNIST Dr split (retain)
Accuracy98.76
6
Image ClassificationCMNIST (test)
Accuracy (Noise 0.1)88.4
6
Image ClassificationShifted CMNIST
Worst Accuracy71.8
5
Showing 25 of 25 rows