Share your thoughts, 1 month free Claude Pro on usSee more

Group Robustness Classification on BREEDS Living-17

84WG Score

ERM Linear Probe

Updated 1mo ago

Evaluation Results

Method	Links
ERM Linear Probe 2022.07		84	98.6	14.6
WISE-FT 2022.07		84	98.6	14.6
DFR (Subsample) 2022.07		84	98.5	14.5
ERM Adapter 2022.07		82.7	98.2	15.5
Contrastive Adapter 2022.07		80	97.5	17.5
DFR (Upsample) 2022.07		78.7	97.3	18.6
ERM Adapter 2022.07		70.7	94	23.3
Contrastive Adapter 2022.07		62	90.9	28.9
ERM Linear Probe 2022.07		53.3	90.8	37.5
WISE-FT 2022.07		53.3	90.8	37.5
Group Prompt ZS 2022.07		48	96.6	48.6
DFR (Subsample) 2022.07		46.7	89.4	42.7
DFR (Upsample) 2022.07		44	86.4	42.4
Group Prompt ZS 2022.07		30	90.6	60.6
Zero-shot (ZS) 2022.07		6	86.7	80.7
Zero-shot (ZS) 2022.07		4	86.6	82.6