Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ImageNet-C

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationImageNet-C (test)
mCE (Mean Corruption Error)22
116
Image ClassificationImageNet-C level 5
Avg Top-1 Acc (ImageNet-C L5)86.2
110
Image ClassificationImageNet-C Severity 5 (test)
Mean Error Rate (Severity 5)24.16
104
Image ClassificationImageNet-C 1.0 (test)
Accuracy (Average)68.8
53
Image ClassificationImageNet-C 1.0 (val)
Corruption Error27.1
40
Image ClassificationImageNet-C blind-spot subset level 5
Accuracy (N)53
35
Image ClassificationImageNet-C level 3 (test)
Acc (Brightness)81.9
34
Test-Time AdaptationImageNet-C level 5 (5k)
Accuracy (Gaussian Noise)61.9
32
Image ClassificationImageNet-C
Gauss Error15.8
32
Image ClassificationImageNet-C JPEG Corruptions
Top-1 Accuracy75.4
24
Image ClassificationImageNet-C Gaussian Noise
Top-1 Accuracy65.2
24
Image ClassificationImageNet-C
mCE28.3
20
Image ClassificationImageNet-C level 5 (5k)
Accuracy (Gaussian Noise)70.1
16
Image ClassificationImageNet-C with Places365-C outliers 1.0 (test)
Accuracy46.9
14
Adaptation with outlier datasetsImageNet-C with Textures-C outliers 1.0 (test)
Accuracy46.8
14
Adaptation with outlier datasetsImageNet-C with Places365-C outliers 1.0 (test)
Accuracy0.469
14
Indiscriminate and Instant AttackImageNet-C (test)
Error Rate64.22
14
Image ClassificationImageNet-C severity level 5 1.0 (test)
Average Error Rate54.4
14
Classification CalibrationImageNet-C severity level 5 (test)
ECE (Mean)0.044
13
Image ClassificationImageNet-C Set 2
Acc (Sev 1)77.1
12
Image ClassificationImageNet-C Severity Level 3, Mixed Shifts v1 (test)
Accuracy72.1
12
Image ClassificationImageNet-C distribution shifted variants
Average Accuracy64.6
12
Image ClassificationImageNet-C 18 (test)
Accuracy (ImageNet-C)48.1
9
Image ClassificationImageNet-C level 1-5
Error Rate (L1-5)36.8
9
RobustnessImageNet-C (val)
mCE40.78
9
Showing 25 of 36 rows