Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Classification on ColorMNIST (ID)
Loading...
100
Accuracy
ERM
53.512
65.581
77.65
89.719
Nov 24, 2025
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
ERM
shortcut severity (ρ)=1.0
2025.11
100
JTT
shortcut severity (ρ)=1.0
2025.11
100
LfF
shortcut severity (ρ)=1.0
2025.11
100
ERM
shortcut severity (ρ)=0.9
2025.11
83.2
JTT
shortcut severity (ρ)=0.9
2025.11
74.7
ERM
shortcut severity (ρ)=0.5
2025.11
74.4
ERM
shortcut severity (ρ)=0.7
2025.11
73.8
SITAR
shortcut severity (ρ)=0.9
2025.11
72.1
SITAR
shortcut severity (ρ)=1.0
2025.11
70.8
SITAR
shortcut severity (ρ)=0.7
2025.11
69.7
LfF
shortcut severity (ρ)=0.9
2025.11
69.1
SITAR
shortcut severity (ρ)=0.5
2025.11
68.8
LfF
shortcut severity (ρ)=0.7
2025.11
68.5
JTT
shortcut severity (ρ)=0.7
2025.11
63.2
LfF
shortcut severity (ρ)=0.5
2025.11
59.8
JTT
shortcut severity (ρ)=0.5
2025.11
55.3
Feedback
Search any
task
Search any
task
