Our new X account is live! Follow @wizwand_team for updates

ImageNet-R

Benchmarks

Task Name	Dataset Name	SOTA Result
Image Classification	ImageNet-R 1.0 (val)	Top-1 Acc71.1	58
Class-Incremental Learning	Split ImageNet-R	Average Forgetting Measure1.27	57
Class-incremental learning	ImageNet-R 10-task	FAA82.06	44
Image Classification	ImageNet-R OfficeHome source (test)	Accuracy0.7718	25
Image Classification	ImageNet-R MiniDomainnet source (test)	Accuracy70.18	25
Class-Incremental Learning	Split ImageNet-R 10 incremental tasks	Forward Accuracy75.06	25
Class-Incremental Learning	ImageNet-R B0 Inc20	Last Accuracy83.87	24
Class-incremental learning	ImageNet-R 20-split	Accuracy79.4	21
Continual Learning	ImageNet-R (test)	Accuracy87.55	20
Image Classification	ImageNet-R strong appearance-shift (test)	Accuracy44.2	14
Continual Learning	ImageNet-R 10 tasks 1.0 (test)	ACC1071.84	14
Continual Learning	ImageNet-R 10 sequential tasks 200 classes	A1:N82.92	14
Continual Learning	ImageNet-R 10 tasks	ACC@1081.14	12
Text-guided Image-to-Image Translation	ImageNet-R TI2I modified	CLIP Similarity32	10
Continual Learning	ImageNet-R 100 tasks	Accuracy70.72	9
Continual Learning	ImageNet-R 50 tasks	Accuracy76.45	9
Continual Learning	ImageNet-R (20 tasks)	Accuracy (20 Tasks)81.14	9
Continual Learning	ImageNet-R 5 tasks	ACC_581.14	9
Few-Shot Class-Incremental Learning	ImageNet-R 10-way 5-shot (test)	Accuracy (Session 0)84.6	8
Controllable Text-to-Image Diffusion	ImageNet-R-TI2I Sketch (test)	Self-Sim0.194	8
Long sequence incremental learning	ImageNet-R Split (test)	FAA0.7657	7
Class Incremental Learning	ImageNet-R Sequential (test)	Last Top-1 Accuracy82.41	7
Controllable Text-to-Image Diffusion	ImageNet-R-TI2I HED (test)	Self-Sim0.153	7
Class-Incremental Learning	ImageNet-R N = 10	Accuracy77.34	6
Class-Incremental Learning	ImageNet-R 50 tasks (test)	Accuracy74.64	6

Showing 25 of 36 rows