SOTA Vision-Language Understanding benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
MMBench	Qwen3-VL-4B-Instruct	Accuracy88.7	64	8d ago
MM-Vet	REVIS	Total Score72.16	43	3mo ago
Vision-Language Benchmark Suite Aggregate		Aggregate Performance (%)100	34	1mo ago
MMBench cn		Accuracy60.6	24	1mo ago
MME	Vanilla	Average Score100	18	1mo ago
Naturalbench	SemDeDup	General Score13.2	13	8d ago
VStarBench	Qwen3-VL-8B	Accuracy83.77	12	14d ago
MVerse VI	Qwen3-VL-8B	Accuracy43.78	12	14d ago
MVerse VO	Qwen3-VL-8B	Accuracy39.97	12	14d ago
MVista	Qwen3-VL-8B	Accuracy75.9	12	14d ago
NegBench VOC2007	InternVL-3.0-8B	Accuracy95.37	11	26d ago
NegBench COCO	InternVL-3.0-8B	Accuracy93.19	11	26d ago
SEED-Bench Image	Vanilla	Average Accuracy100	11	1mo ago
Vision-Language Evaluation Suite MMB, MMStar, MMMU, Hallusion, AI2D, OCR, SEED, SQA (test val)	Qwen2-VL-7B (Teacher)	MMB Score80.7	10	3mo ago
MMStar (test)	ETTC	Accuracy63.73	7	2d ago
MMBench CN v1.1	Qwen3-Omni	Accuracy87.7	5	1mo ago
MMBench EN v1.1	MiniCPM-o 4.5	Accuracy89	5	1mo ago
Winoground	CROCScore	Text Accuracy61.5	5	1mo ago
MMBench (test)		Overall Accuracy78.8	4	1d ago
Quantiphy	Phi-4-Multimodal	Average MRA27.4	4	22d ago
MMBench (dev)	Prompt Highlighter	Accuracy69.7	4	3mo ago
MME Perception	Prompt Highlighter	MME Score1,552.5	4	3mo ago
Vision-Language Evaluation Suite (ChartQA, DocVQA, AI2D, VQA, AndroidControl, CountBenchQA)	Our Method	ChartQA Accuracy68.1	2	2mo ago
Vision-Language Benchmarks Hard Partition	VISOR	ChartQA Score78.1	2	2mo ago
Vision-Language Benchmarks Easy Partition	Qwen2-VL-2B	RealWorldQA Accuracy61.1	2	2mo ago

Showing 25 of 25 rows