DataComp

Benchmarks

Task Name	Dataset Name	SOTA Result
Zero-shot Image Classification	DataComp	DataComp Score63.47	28
Image Classification	DataComp 38 downstream tasks medium (test)	Accuracy66.7	12
Zero-shot classification	DataComp (test)	DataComp Average57.34	10
Multi-modal Representation Learning	DataComp medium Evaluation Suite	Average Score37.7	9
Zero-shot Evaluation	DataComp full (test)	Mean Zero-shot Accuracy63.47	8
Multi-modal Evaluation	DataComp	Datacomp Average31.89	5
Multi-modal Classification	DataComp Evaluation Suite 1.0	DataComp Average39.16	5
Image Classification	DataComp	Average Score25.08	5
Classification	Datacomp DFN-1B track	Average Performance (Datacomp)57.34	5
Classification	Datacomp DFN-192M track	Average Performance (Datacomp)54.9	5
Classification	Datacomp DFN-14M track	Average Performance39.16	5
Classification	Datacomp CC12M track	Average Performance31.89	5
Classification	Datacomp CC3M track	Average Performance25.08	5
Text-to-Image Retrieval	DataComp 15M	Accuracy74	4

Showing 14 of 14 rows