VTAB

Benchmarks

Task Name	Dataset Name	SOTA Result
Image Classification	VTAB 1k	Overall Mean Accuracy79	204
Image Classification	VTAB 1k (test)	Accuracy (Natural)89.09	121
Image Classification	VTAB-1K 1.0 (test)	Natural Accuracy86	102
Visual Task Adaptation	VTAB 1K	Average Accuracy78.02	78
Image Classification	VTAB v2 (test)	Mean Accuracy70.4	39
Class-Incremental Learning	VTAB	Avg Accuracy92.6	31
Image Classification	VTAB-6	Accuracy89.8	29
Visual Task Adaptation	VTAB-1k v1 (test)	Mean Accuracy79.1	29
Image Classification	VTAB	Overall Accuracy58.4	24
Class-Incremental Learning	VTAB B0 Inc10	Last Accuracy94.96	22
Image Classification	vtab pets	Accuracy97.339	22
Visual Task Adaptation	VTAB	VTAB Mean Accuracy62.66	16
Visual Adaptation	VTAB 1k (test)	Natural Accuracy82.5	16
Visual Task Adaptation	VTAB 1K (test)	CIFAR-100 Accuracy78.8	15
Class-Incremental Learning	VTAB CIL, T=5 (test)	Avg Accuracy92.2	11
Class-incremental learning	VTAB T=5 (test)	Final Accuracy94.29	10
Image Classification	VTAB natural	Accuracy76.9	9
Uncertainty Calibration	VTAB	ECE13.6	8
Continual Learning	VTAB	Backward Transfer (BwT)0.041	8
Image Classification	VTAB	Caltech101 (All Acc)89	8
Continual Learning	VTAB	Training Time (s)0.11	6
Image Classification	vtab dmlab	Accuracy19	6
Image Classification	vtab pcam	Accuracy69	6
Continual Learning	VTAB (test)	Inference Time (ms)7.38	5
Image Classification	VTAB 19 tasks (test)	Accuracy77.63	4

Showing 25 of 30 rows