Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SUN397

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationSUN397
Accuracy82.4
116
Image ClassificationSUN397 base-to-new generalization
New Accuracy79.63
48
Fine-grained ClassificationSUN397
Top-1 Accuracy78.4
39
Image ClassificationSUN397
Robust Accuracy36.39
31
Fine-grained classificationSUN397 (novel classes)
ECE0.77
28
Fine-grained classificationSUN397 (base classes)
Accuracy81.68
27
Image ClassificationSUN397
AutoAttack Robustness54.26
19
Image ClassificationSUN397 novel classes
Accuracy80.18
18
Image ClassificationSUN397 MDCII Order-II
Transfer Accuracy81.8
15
Image ClassificationSUN397 Base
Top-1 Accuracy83.7
14
Image ClassificationSUN397 MDCII Order-I
Transfer Accuracy71.1
13
Image ClassificationSUN397 Base-to-Novel
Base Accuracy83.2
12
Scene RecognitionSUN397 New classes
Accuracy79.2
12
Scene RecognitionSUN397 Base classes
Accuracy83.23
12
Scene ClassificationSUN397
Base Accuracy83.23
11
ClassificationSUN397 Natural imbalance (test)
bACC33.3
11
ClassificationSUN397
Robust Accuracy41.52
10
Image ClassificationSUN397 (first split)
Accuracy66.2
10
Image ClassificationSUN397 (test)
Accuracy (K=5)49.3
9
Image ClassificationSUN397
Base Score82.69
8
Out-Of-Distribution DetectionSUN397 (test)
AUROC0.59
8
Image ClassificationSUN397 16-shot
Accuracy66.7
7
Image ClassificationSUN397 all-to-all
Accuracy68.3
7
Image ClassificationSUN397 2010 (H)
Top-1 Accuracy80.35
6
Image ClassificationSUN397 2010 (New classes)
Top-1 Accuracy78.7
6
Showing 25 of 33 rows