Zero-shot Image Classification

Benchmarks

Dataset Name	SOTA Method	Metric
ImageNet-1K	SigLIP ViT-L/16-res256	Top-1 Accuracy80.5	115	1mo ago
ImageNet 1K (val)	REACT (Locked-Text Gated-Image)	Accuracy78.1	49	2mo ago
AwA2 (test)	ACR	Metric U74.1	46	3mo ago
ImageNet zero-shot	EVA-CLIP	Top-1 Accuracy83.5	35	3mo ago
CUB	VSPCN	U Score72.8	34	3mo ago
DataComp	TuneCLIP	DataComp Score63.47	28	3mo ago
DTD	CSR	Robust Accuracy (PGD-100, eps=1/255)39.1	25	15d ago
ImageNet (val)		Accuracy80.1	24	3mo ago
ImageNet-R (test)	REACT (Locked-Text Gated-Image)	Accuracy89.9	23	3mo ago
ImageNet shift		Accuracy69.6	22	3mo ago
SUN unseen (test)	DEM	Top-1 Acc61.9	22	3mo ago
aPY (test)		Metric u48.1	21	3mo ago
ImageNet-Sketch (test)	REACT (Locked-Text Gated-Image)	Accuracy65.4	19	3mo ago
ImageNet-A (test)	CLIP	Accuracy0.705	19	3mo ago
ImageNet V2 (test)	REACT (Locked-Text Gated-Image)	Accuracy71.5	19	3mo ago
CIFAR-10	TIFS	Zero-shot Accuracy89.86	18	19d ago
ObjectNet		Zero-shot Accuracy29.16	18	19d ago
STL		Zero-shot Accuracy0.9646	18	19d ago
Food		Zero-shot Accuracy81.16	18	19d ago
Average Zero-shot (15 datasets)	WISE-FT	Clean Accuracy60.4	18	2mo ago
16-dataset Zero-Shot Adversarial Robustness (ZSAR) Evaluation Suite	TGA-ZSR	TinyImageNet Accuracy69.78	18	3mo ago
ImageNet (val)	TAME	Adversarial Accuracy61.7	17	15d ago
ImageNet 1k (test)		Accuracy (Zero-shot)80.11	16	2mo ago
14 Robustness Benchmark Datasets (ImageNet, CalTech, Cars, CIFAR10, CIFAR100, DTD, EuroSAT, FGVC, Flowers, ImageNet-R, ImageNet-S, PCAM, OxfordPets, STL-10) (test)	TeCoA	ImageNet Accuracy80.11	16	2mo ago
ImageNet	TAME	PGD Accuracy57	15	15d ago

Showing 25 of 79 rows