Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Learning to Defer on SVHN
Loading...
0.0579
Deferral Loss
MILD
0.056672
0.064961
0.07325
0.081539
Apr 30, 2026
Deferral Loss
Ratio of Expert Deferral (%) - Expert 1
Ratio of Expert Deferral (%) - Expert 2
Ratio of Expert Deferral (%) - Expert 3
Ratio of Expert Deferral (%) - Expert 4
Ratio of Expert Deferral (%) - Expert 5
Updated 1mo ago
Evaluation Results
Method
Method
Links
Deferral Loss
Ratio of Expert Deferral (%) - Expert 1
Ratio of Expert Deferral (%) - Expert 2
Ratio of Expert Deferral (%) - Expert 3
Ratio of Expert Deferral (%) - Expert 4
Ratio of Expert Deferral (%) - Expert 5
MILD
Setup=(I), Cost Type=e...
2026.04
0.0579
77.16
17.39
5.45
-
-
MILD
Setup=(II), Cost Type=...
2026.04
0.0634
50.63
20.55
23.86
4.96
-
MILD
Setup=(III), Cost Type...
2026.04
0.0707
45.78
19.31
15.85
6.73
12.33
TDEF
Setup=(I), Cost Type=e...
2026.04
0.0752
51.58
26.99
21.43
-
-
TDEF
Setup=(II), Cost Type=...
2026.04
0.0831
32.44
23.27
26.61
17.68
-
TDEF
Setup=(III), Cost Type...
2026.04
0.0886
27.21
19.98
20.28
11.78
20.75
Feedback
Search any
task
Search any
task
