Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

tinyimagenet

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image ClassificationTinyImageNet (test)
Accuracy90.23
366
Image ClassificationTinyImageNet (val)
Accuracy90.65
240
Image ClassificationTinyImageNet (test)
Communication Rounds342
56
Image ClassificationTinyImageNet 100 tasks (test)
Accuracy33.2
51
Continual LearningTinyImageNet 100 tasks (test)
Average Forgetting Rate11.7
51
Multi-class classificationTinyImageNet Dirichlet non-IID setting (test)
Top-5 Acc52.9
33
Online Continual LearningTinyImageNet 100/2
Accuracy12.6
31
Generative Image SynthesisTinyImageNet
FID15.43
29
Generative Image SynthesisTinyImageNet BigGAN
FID14.15
29
Class-Incremental LearningTinyImageNet (test)
Accuracy52.77
29
Continual LearningTinyImageNet 25-split
ACC58.28
29
Accuracy EstimationTinyImageNet
MAE0.612
27
Image ClassificationTinyImageNet (test)
Accuracy64.23
24
Membership InferenceTinyImageNet
Loss0.51
23
Communication OverheadTinyImageNet (test)
Upload Size20.48
21
Online Continual LearningTinyImageNet Sequential (test)
Accuracy15.97
21
Exemplar-Free Class-Incremental LearningTinyImageNet (test)
Avg Increment36.5
18
Open-set recognitionTinyImageNet 20 closed, 180 open classes 1.0
AUROC86.7
18
Image ClassificationTinyImageNet et = 1/255 (val)
Standard Error74.29
18
Image ClassificationTinyImageNet (test)
Accuracy74.69
16
Membership Inference DefenseTinyImageNet (test)
AUC (Loss-Series)0.7
15
Anomaly DetectionTinyImageNet 20 classes
AUROC0.911
15
Offline Task-Incremental LearningS-TinyImageNet (test)
Forgetting13.1
15
Offline Class-Incremental LearningS-TinyImageNet (test)
Forgetting Rate31.06
15
Continual LearningS-TinyImageNet streaming (test)
Forgetting Rate (FRG)6.89
15
Showing 25 of 51 rows