Multi-image Understanding

Benchmarks

Dataset Name	SOTA Method	Metric
MMIU	InternVL2.5-78B	Accuracy55.8	65	3mo ago
MuirBench	Gemini 2.5 Flash	Score74.5	41	2mo ago
QBench2	DelimScaling	Accuracy81.7	30	4mo ago
MMT-Bench (val)	Qwen2-VL-72B	Score71.8	23	4mo ago
BLINK (val)		Score68	23	4mo ago
MIBench	Qwen2.5-VL	Accuracy72.42	22	4mo ago
MileBench (test)	FlashCache	Temporal Multi-Image Score (Task T)57.3	21	4mo ago
MuirBench (test)		Accuracy68	21	4mo ago
MMIU 106 (test)		Score72.1	19	4mo ago
MuirBench 142 (test)		Score86.1	19	4mo ago
MuirBench Multi-image Understanding		Accuracy62.3	17	4mo ago
MIRB (test)	Qwen2VL-7B	Accuracy60.8	12	4mo ago
Blink (test)	InternVL2-Llama3-76B	Accuracy56.8	12	4mo ago
BLINK multi-img	Qwen2.5-VL-7B	Accuracy55.6	11	4mo ago
MMT (val)	InternVL2-Llama3-76B	Accuracy67.4	11	4mo ago
MMIU (test)	Qwen2VL-7B	Accuracy52.6	11	4mo ago
NLVR2 (test)	attention-masking strategy	Accuracy87.3	9	4mo ago
MEGABench (test)		Accuracy54.2	7	4mo ago
MMSI-Bench	Gemini 1.5 Pro	Accuracy36.9	6	4mo ago
Mantis (Eval)	MiniCPM-o 4.5	Score79.7	5	2mo ago
Blink	Ours	Accuracy61.18	5	3mo ago
Mantis-Eval (test)	Qwen3-VL-30B-A3B	Accuracy66.36	2	1mo ago

Showing 22 of 22 rows