Our new X account is live! Follow @wizwand_team for updates

Document Visual Question Answering on DUDE

60ANLS

GPT-4o+Ours (Spot-IT)

Updated 4d ago

Evaluation Results

Method	Links
GPT-4o+Ours (Spot-IT) 2025.08		60	45	60
Claude-3.7-Sonnet 2025.12		58.1	-	-
GPT-4o+CoT 2025.08		58	43	57
GPT-4o 2025.08		55	42	56
GPT-4o 2025.12		52.7	-	-
GPT-4o-mini+Ours (Spot-IT) 2025.08		52	41	55
GPT-4.1 2025.12		50.2	-	-
GPT-4o-mini 2025.08		47	34	50
GPT-4o+OCR 2025.08		47	34	47
GPT-4o mini 2025.12		46.5	-	-
CogDoc 2025.12		46.2	-	-
mPLUG-DocOwl2 2025.12		45.6	-	-
Gem-1.5-Flash+Ours (Spot-IT) 2025.08		45	34	47
SV-RAG 2025.12		45	-	-
Qwen2.5-VL-72B-Instruct 2025.12		44.5	-	-
VDocRAG 2025.12		44	-	-
InternVL3-8B 2025.12		43.4	-	-
MiMo-VL-7B-SFT 2025.12		43.1	-	-
VisRAG 2025.12		43.1	-	-
FRAG 2025.12		43.1	-	-
Gem-1.5-Flash 2025.08		42	30	42
Qwen2.5-VL-7B-Instruct 2025.12		41.8	-	-
Docopilot 2025.12		40.7	-	-
M3DocRAG 2025.12		39.5	-	-
Qwen2-7B+Ours (Spot-IT) 2025.08		32	27	37
Qwen2-7B 2025.08		28	21	32
Llama-3.2+Ours (Spot-IT) 2025.08		24	19	29
Llama-3.2-VL-11B 2025.08		18	13	23
Llama-3.2+CoT 2025.08		17	11	23
Llama-3.2+OCR 2025.08		8	5	19