Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Waterbirds

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationWaterbirds
WG Accuracy97.2
283
Image ClassificationWaterbirds (test)
Worst-Group Accuracy97.1
214
Image ClassificationWaterbirds In-context training: iNaturalist (test)
Average Worst-Group Accuracy92.23
140
Image ClassificationWaterbirds severe in-distribution context (test)
Worst-group Accuracy91.38
104
Image ClassificationWaterbirds In-context training (test)
Average Worst-Group Accuracy93.4
104
ClassificationWaterbirds (test)
Test Accuracy98.2
40
ClassificationWaterbirds Background (test)
Accuracy91.8
24
Zero-shot classification fairnessWaterbirds Background
Accuracy (Zero-shot)88.6
24
Image ClassificationWaterbirds 95% correlation (test)
Worst-group Accuracy92.5
23
Robust ClassificationWaterbirds (test)
WGA92.9
22
Image ClassificationWaterbirds 100%
Accuracy Variance across Groups16
22
Image ClassificationWaterbirds 95%
Accuracy Variance (Group)6
22
Object ClassificationWaterbirds (test)
Worst-Group Accuracy90
22
Image ClassificationWaterbirds 100% correlation (test)
Worst-group Accuracy91.9
21
Image ClassificationWaterbirds
Relative Accuracy Improvement16.68
18
Binary ClassificationWaterbirds (OOD)
Accuracy98.9
18
Image ClassificationWaterbirds 95% (test)
Worst-Group Accuracy91.8
18
Error Slice DiscoveryWaterbirds
Precision@1083
17
Image ClassificationWaterbirds 100% (test)
Worst Group Accuracy90.7
17
Model SteeringWaterBirds (test)
Worst Group Accuracy98.5
15
Image ClassificationWaterbirds Flip (test)
Accuracy90.6
14
Image ClassificationWaterbirds Original (test)
Accuracy98.4
14
Group RobustnessWaterbirds (test)
WGA92.67
13
Subpopulation ShiftWaterbirds
Average Accuracy (AA)92.12
12
ClassificationWaterbirds bias-free (test)
Balanced Accuracy90.8
11
Showing 25 of 60 rows