Multi-modal Understanding

Benchmarks

Dataset Name	SOTA Method	Metric
LLaVA-Bench Wild	GPT4V	LLaVA^W Score91.2	52	2d ago
MMBench (dev)	Mini-Gemini-HD	Overall Score80.6	40	2d ago
SEED-Bench (overall)	CSR	Overall Score62.9	40	3d ago
MMBench EN		Overall Score86.3	39	3d ago
MMVet		Accuracy76.2	35	3d ago
MMBench EN	InternVL2.5-78B	Accuracy88.3	34	2d ago
MMBench V1.1	InternVL3.5-38B	Accuracy87.03	22	3d ago
MMBench	Oryx-1.5	Mean Accuracy86.3	16	3d ago
SEED-Bench all (val)		Accuracy65.6	14	3d ago
MMBench (test)	ScalSelect	MMBench Accuracy (En)65.3	12	3d ago
MM-Vet	LLaVA1.5-BPO	Rec46.9	11	3d ago
MME v1.0 (test)	LLaVA-1.5-13B	MME^P Score1,531.3	10	3d ago
MME	Vanilla Attack	M(cl, nc)90.85	9	3d ago
General Multi-modal Evaluation Suite (VQAv2, GQA, VisWiz, ScienceQA-IMG, TextVQA, POPE, MMBench, MM-Vet) standard (test val)	MoE-LLaVA-Phi DeRS-SM	VQAv2 Accuracy77.7	9	3d ago
MMBench EN 1.1 (dev)	Pixtral-12B	Accuracy84.31	8	3d ago
Q-Bench (test)	mPLUG-Owl2	Overall Score62.9	8	3d ago
CV-Bench, BLINK, RealWorldQA, MathVista, MMStar, MMVet	LATTE	Average Score53.8	8	3d ago
SEED-IMG		Accuracy69.7	7	2d ago
SEED-IMG I	Vanilla	Accuracy66.9	7	2d ago
LLaVA Multi-modal Evaluation Suite (GQA, MMB, MME, POPE, SQA, VQAv2, TextVQA, MMMU, SEED-I) v1.6 (test)		GQA Accuracy65.4	5	2d ago
MMBench	TaLo	S-I-U52.5	3	3d ago
LLaVA Multi-modal Evaluation Suite (GQA, MMB, MME, POPE, SQA, VQAv2, TextVQA, MMMU, SEED-I) v1.6 (test val)	-	GQA-	0	3d ago

Showing 22 of 22 rows