Multi-modal Understanding

Benchmarks

Dataset Name	SOTA Method	Metric
LLaVA-Bench Wild	GPT4V	LLaVA^W Score91.2	86	4d ago
MMBench EN	InternVL2.5-78B	Accuracy88.3	64	18d ago
MMBench EN		Overall Score86.3	55	1mo ago
LLaVA Multi-modal Evaluation Suite (GQA, MMB, MME, POPE, SQA, VQAv2, TextVQA, MMMU, SEED-I) v1.6 (test)		Average Score100	53	1mo ago
MMBench (dev)	Mini-Gemini-HD	Overall Score80.6	40	1mo ago
SEED-Bench (overall)	CSR	Overall Score62.9	40	1mo ago
MMVet		Accuracy76.2	40	18d ago
MMBench	Oryx-1.5	Mean Accuracy86.3	32	1mo ago
MMBench V1.1	InternVL3.5-38B	Accuracy87.03	22	1mo ago
SEED-IMG		Accuracy69.7	20	1mo ago
MM-Vet	LLaVA1.5-BPO	Rec46.9	19	23d ago
MME		MME Score1,842	17	25d ago
MuirBench		Score59.6	16	1mo ago
MMMU Pro (Overall)		Score38.3	16	1mo ago
TVL Benchmark	TVL-LLaMA (ViT-Base)	SSVTP Score6.16	14	11d ago
SEED-Bench all (val)		Accuracy65.6	14	1mo ago
MMBench (test)	ScalSelect	MMBench Accuracy (En)65.3	12	1mo ago
MMMU	iLLaVA	Accuracy (77.8% reduction ratio)64.3	11	1mo ago
SEED-ALL	LLaVA-1.5 Vanilla 13B	Accuracy61.6	10	1mo ago
MME v1.0 (test)	LLaVA-1.5-13B	MME^P Score1,531.3	10	1mo ago
MME	Vanilla Attack	M(cl, nc)90.85	9	1mo ago
General Multi-modal Evaluation Suite (VQAv2, GQA, VisWiz, ScienceQA-IMG, TextVQA, POPE, MMBench, MM-Vet) standard (test val)	MoE-LLaVA-Phi DeRS-SM	VQAv2 Accuracy77.7	9	1mo ago
MMBench EN 1.1 (dev)	Pixtral-12B	Accuracy84.31	8	1mo ago
Q-Bench (test)	mPLUG-Owl2	Overall Score62.9	8	1mo ago
CV-Bench, BLINK, RealWorldQA, MathVista, MMStar, MMVet	LATTE	Average Score53.8	8	1mo ago

Showing 25 of 32 rows