Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Classification on Multi-Color MNIST (Bias Analysis)
Loading...
100
Accuracy (Aligned/Aligned)
Vanilla
98.544
98.922
99.3
99.678
Jul 20, 2022
Accuracy (Aligned/Aligned)
Accuracy (Aligned/Conflicting)
Accuracy (Conflicting/Aligned)
Accuracy (Conflicting/Conflicting)
Accuracy (Unbiased)
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy (Aligned/Aligned)
Accuracy (Aligned/Conflicting)
Accuracy (Conflicting/Aligned)
Accuracy (Conflicting/Conflicting)
Accuracy (Unbiased)
Vanilla
left color ratio=0.99,...
2022.07
100
97.1
27.5
5.2
57.4
EIIL
left color ratio=0.99,...
2022.07
100
97.2
70.8
10.9
69.7
DebiAN (w/o UA)
left color ratio=0.99,...
2022.07
100
97.2
71.6
13.8
70.6
DebiAN
left color ratio=0.99,...
2022.07
100
95.6
76.5
16
72
LfF
left color ratio=0.99,...
2022.07
99.6
4.7
98.6
5.1
52
PGI
left color ratio=0.99,...
2022.07
98.6
82.6
26.6
9.5
54.3
Feedback
Search any
task
Search any
task
