Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SUN397

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationSUN397 base-to-new generalization
New Accuracy79.63
48
Fine-grained classificationSUN397 (novel classes)
ECE0.77
28
Fine-grained classificationSUN397 (base classes)
Accuracy81.68
27
Fine-grained ClassificationSUN397
Top-1 Accuracy78.4
25
Image ClassificationSUN397 novel classes
Accuracy80.18
18
Image ClassificationSUN397 Base
Top-1 Accuracy83.7
14
Scene RecognitionSUN397 New classes
Accuracy79.2
12
Scene RecognitionSUN397 Base classes
Accuracy83.23
12
ClassificationSUN397 Natural imbalance (test)
bACC33.3
11
Image ClassificationSUN397
AutoAttack Robustness24.56
10
ClassificationSUN397
Robust Accuracy41.52
10
Image ClassificationSUN397 (first split)
Accuracy66.2
10
Out-Of-Distribution DetectionSUN397 (test)
AUROC0.59
8
Image ClassificationSUN397 all-to-all
Accuracy68.3
7
Image ClassificationSUN397
Acc (1-shot)70.68
6
Image ClassificationSUN397
ACE3.3
5
Image ClassificationSUN397 (seen)
Accuracy80.6
4
Image ClassificationSUN397 unseen prompts
Accuracy77.87
4
ClassificationSUN397 split 1 (test)
Accuracy65.6
4
Scene & action recognitionSUN397 T=30
Last Task Accuracy (AT)83.73
1
Showing 20 of 20 rows