Multimodal Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
ScienceQA (test)	LLaVa + GPT-4 (judge)	Accuracy92.53	73	6d ago
ScienceQA	CASHEW	Accuracy97.8	61	2d ago
MMBench CN	MergeMix	Accuracy81.18	37	1mo ago
MMQA		Accuracy70.5	36	3mo ago
M2RAG	Ours-top3	B-1 Score42.95	28	1mo ago
SUPERGLASSES 1.0 (Leaderboard)	SUPERLENS‡ (Ours)	Accuracy (Easy)49.68	28	1mo ago
ManyModalQA (test)	MAMMQA	Accuracy (Text)92.5	27	1mo ago
MMBench en (test)		Accuracy89	26	1mo ago
LiveVQA	OpenSearch-VL-32B	Pass@170.5	24	27d ago
MM-Vet	Qwen3-VL-4B	Total Score68.3	24	3mo ago
Aggregate (Open-WikiTable, 2WikiMQA, InfoSeek, Dyn-VQA, TabFact, WebQA)	MoRE-7B	Average Score55.93	22	1mo ago
WebQA	MoRE-7B	F1-Recall90.92	22	1mo ago
TabFact	MoRE-3B	F1-Recall52.6	22	1mo ago
Dyn-VQA	R1-Distill-Qwen-32B	F1-Recall39.98	22	1mo ago
2WikiMQA	MoRE-7B	F1-Recall55.47	22	1mo ago
Open-WikiTable	MoRE-7B	F1 Recall53.9	22	1mo ago
ScienceQA v1.3 (test)		NAT Score0.9019	21	3mo ago
SEED-Bench	QMoSLoRA	Accuracy (All)71.1	21	3mo ago
MMQA	FES-RAG-top5	BLEU-149.31	20	1mo ago
MMQA k=1		ROrig@k57.4	20	6d ago
MME-RealWorld-Lite 1.0 (test)	HART-7B	Perception (AD) Acc57.7	19	2mo ago
MMBench EN V1.1		Accuracy67.53	18	1d ago
SEED-Bench IMG	LASER	Accuracy71.56	18	1d ago
MULTIMODALQA (test)		Overall Accuracy75.5	17	1mo ago
9 Multimodal Benchmarks (VQAv2, GQA, VizWiz, SQA-IMG, TextVQA, POPE, MME, MMB, MMB-CN) (test val)		VQAv2 Accuracy80	15	3mo ago

Showing 25 of 64 rows