Share your thoughts, 1 month free Claude Pro on usSee more

Vision-Language Reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
VL Reasoning Benchmarks	FRISM	MVista Score74	28	3mo ago
VL Reasoning Benchmarks MathVista, MVerse, MathVision, MMMU, R1-OV, MMStar	FRISM	MathVista Acc79.8	25	3mo ago
UHR-Micro (test)	MAP-Agent	Average Score44.1	16	21d ago
SQA3D ScanNet scenes (test)	DINOv3 + SpatialBoost	BLEU-154.9	13	2mo ago
ScanQA ScanNet scenes (test)	DINOv3 + SpatialBoost	BLEU-143.3	13	2mo ago
CODA-LM 1.0 (test)	Qwen2.5-VL-7B + Ours	Barrier79.8	13	3mo ago
CVBench	Qwen3-VL-8B + GRPO	Accuracy86.16	12	3mo ago
VRSBench	SkyNative	Accuracy69.38	10	15d ago
MMStar cleaned	Jigsaw + CARE	Score77.59	10	3mo ago
Winoground	LLaVA-1.5 13B	Simple Acc59.88	9	3mo ago
MathVista (test)	Top Probability + Confidence Modulation	Accuracy34.6	7	6d ago
SugarCrepe (test)	Q4 system redistr (prop)	Simple Accuracy62.75	7	3mo ago
NaturalBench (test)	Q4 system redistr (prop)	Simple Accuracy66.02	7	3mo ago
MME (test)		Simple Accuracy78.98	7	3mo ago
HallusionBench (test)	Q4 system redistr (prop)	Simple Accuracy53.31	7	3mo ago
BEAF (test)	Q4 system redistr (prop)	Simple Accuracy88.4	7	3mo ago
MMStar	ETTC	Accuracy60.07	6	2d ago
CheXthought 300 1.0 (test)	CheXthought Data	Comprehensiveness of Findings4.67	4	1mo ago
SSRBench	SOLE-R1	General Score (SSRBench)85.6	4	2mo ago
nuScenes (reasoning)	Qwen1.5-0.5B	BERT F1 Score67	4	2mo ago
Winoground	CLIP	Text Score30.5	4	3mo ago
Vision-Language Reasoning Suite (MathVerse, MathVista, MathVision, MMMU-Pro, We-Math) (test)	PLM-HoneyBee-3B-GRPO	Average Accuracy46.2	3	2mo ago
CLEVR CoGenT (Split B)	NeSyCoCo	Accuracy78.8	3	3mo ago
CLEVR-CoGenT (Split A)	MDETR	Accuracy99.7	3	3mo ago
CLEVR-SYN hard (val)	NeSyCoCo	Accuracy73.4	2	3mo ago

Showing 25 of 28 rows