Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ImageNet-C

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationImageNet-C (test)
mCE (Mean Corruption Error)22
110
Image ClassificationImageNet-C level 5
Avg Top-1 Acc (ImageNet-C L5)86.2
61
Image ClassificationImageNet-C 1.0 (test)
Accuracy (Average)68.8
53
Image ClassificationImageNet-C Severity 5 (test)
Error Rate (Gaussian)5.2
42
Image ClassificationImageNet-C 1.0 (val)
Corruption Error27.1
40
Image ClassificationImageNet-C level 3 (test)
Acc (Brightness)81.9
34
Indiscriminate and Instant AttackImageNet-C (test)
Error Rate64.22
14
Image ClassificationImageNet-C severity level 5 1.0 (test)
Average Error Rate54.4
14
Classification CalibrationImageNet-C severity level 5 (test)
ECE (Mean)0.044
13
Image ClassificationImageNet-C
Gauss Error44
12
Image ClassificationImageNet-C Set 2
Acc (Sev 1)77.1
12
Image ClassificationImageNet-C Severity Level 3, Mixed Shifts v1 (test)
Accuracy72.1
12
Image ClassificationImageNet-C 18 (test)
Accuracy (ImageNet-C)48.1
9
Image ClassificationImageNet-C level 1-5
Error Rate (L1-5)36.8
9
RobustnessImageNet-C (val)
mCE40.78
9
Image ClassificationImageNet-C
mCE28.3
8
Image ClassificationImageNet-C Severity 1
Top-1 Acc75.24
8
Image ClassificationImageNet-C mild scenario (severity level 5)
Gauss Error2.2
6
Image ClassificationImageNet-C level 2
Brightness81.1
6
Image ClassificationImageNet-C level 1 1.0 (test)
Brightness Accuracy81.6
6
Image ClassificationImageNet-C 256x256 (val)
Accuracy35.7
5
Image Classification CalibrationImageNet-C trained on ImageNet-LT Gaussian noise corruption level 5 (test)
ECE12.91
5
Image ClassificationImageNet-C distribution shifted variants
Severity 1 Accuracy66
5
Image ClassificationImageNet-C extra corruptions (test)
Average Accuracy49.6
4
Trustworthiness PredictionImageNet-C Defocus blur severity-level-5 (val)
Accuracy31.83
4
Showing 25 of 26 rows