Image-Text Matching

Benchmarks

Dataset Name	SOTA Method	Metric
Sugar-Crepe	LamRA	Accuracy93.5	28	1mo ago
Winoground		Text Agreement Score89.5	26	4mo ago
Foil	PAPSP-S	AURC0.245	23	4mo ago
VL-Checklist	PAPSP-S	AURC0.258	23	4mo ago
What’sUp	PAPSP-S	AURC26.2	23	4mo ago
SugarCrepe	ReCoVERR	AURC16.7	17	4mo ago
CC-Neg	U-MARVEL+	Accuracy86.1	17	4mo ago
EQ-SD EQBEN	FIBER + EQSIM	Text Score90.81	14	4mo ago
EQ-KUBRIC EQBEN	FIBER + EQSIM	Text Score51.9	14	4mo ago
EQ-AG EQBEN	FIBER	Text Score32.49	14	4mo ago
EQ-GEBC (EQBEN)	FIBER	Text Score25.19	14	4mo ago
YouCook2 EQBEN	BLIP	Text Score59.22	14	4mo ago
MSCOCO HN	OpenCLIP (ViT-B-32)	I-to-T Score49.07	11	4mo ago
CC-Neg (unseen)	ELVA-7B	Accuracy87.3	9	1mo ago
Winoground 1.0 (full)	MTurk Human	Text Agreement Score89.5	5	4mo ago
Urban-1k hard-negative perturbations	HyFL-CLIP	Accuracy (%)62.07	4	23d ago
MSCOCO, Flickr30K, Visual Genome, and Conceptual Captions sequence	Enhanced EWC with Cross-Modal Knowledge Retention	Backward Transfer-0.05	4	2mo ago
Winoground clean	syn-BLIP	Text Agreement Score52.63	4	4mo ago
SugarCREPE sampled balanced	VisReP	Accuracy58.7	3	4mo ago
Winoground (full)	VisReP	Accuracy52.7	3	4mo ago

Showing 20 of 20 rows