Our new X account is live! Follow @wizwand_team for updates

Science Question Answering on ScienceQA (Component Metrics)

88.6IMG Score

Qwen2.5-VL-7B-Instruct

Updated 3d ago

Evaluation Results

Method
Qwen2.5-VL-7B-Instruct 2026.02	88.6	-	-	-	-	-	-	-	-
HII-DPO 2026.02	88.5	-	-	-	-	-	-	-	-
HII-DPO 2026.02	86.7	-	-	-	-	-	-	-	-
Qwen2-VL-7B-Instruct 2026.02	85.7	-	-	-	-	-	-	-	-
Qwen2-VL-2B-Instruct 2026.02	76.9	-	-	-	-	-	-	-	-
HII-DPO 2026.02	76.9	-	-	-	-	-	-	-	-
SENTINEL 2026.02	72.8	-	-	-	-	-	-	-	-
HII-DPO 2026.02	72.8	-	-	-	-	-	-	-	-
vanilla-DPO 2026.02	71.8	-	-	-	-	-	-	-	-
baseline 2026.02	71.6	-	-	-	-	-	-	-	-
HSA-DPO 2026.02	71.3	-	-	-	-	-	-	-	-
HA-DPO 2026.02	69.7	-	-	-	-	-	-	-	-
mDPO 2026.02	69.4	-	-	-	-	-	-	-	-
SENTINEL 2026.02	69.2	-	-	-	-	-	-	-	-
Re-Align 2026.02	69	-	-	-	-	-	-	-	-
POVID 2026.02	68.8	-	-	-	-	-	-	-	-
HII-DPO 2026.02	68.6	-	-	-	-	-	-	-	-
RLAIF-V 2026.02	68.2	-	-	-	-	-	-	-	-
mDPO 2026.02	67.3	-	-	-	-	-	-	-	-
TPO 2026.02	67.1	-	-	-	-	-	-	-	-
baseline 2026.02	66.8	-	-	-	-	-	-	-	-
Re-Align 2026.02	66.6	-	-	-	-	-	-	-	-
MIND_base 2025.12	0.9276	0.9307	0.9674	0.8709	0.9242	0.8927	0.9291	0.9117	0.9229
DPMM-CoT_base 2025.12	0.9048	0.9272	0.8785	0.8991	0.9272	0.9129	0.9145	0.9011	0.9097
Multimodal-T-SciQ_base 2025.12	0.9033	0.9152	0.9145	0.9245	0.9194	0.9226	0.9211	0.911	0.9175
Gemini+RMR 2025.12	0.8969	0.9179	0.9426	0.8964	0.914	0.9101	0.9284	0.8978	0.9175
MC-CoT_base 2025.12	0.883	0.9187	0.8459	0.93	0.9228	0.9275	0.9064	0.9064	0.9064
LLaVA 2025.12	0.88	0.9036	0.9595	0.88	0.8949	0.9066	0.9093	0.909	0.9092
Human 2025.12	0.875	0.9023	0.8497	0.8748	0.896	0.881	0.9159	0.8242	0.884
LaVIN 2025.12	0.8746	0.8925	0.9494	0.8524	0.8851	0.8808	0.9016	0.8807	0.8941
DDCoT_base 2025.12	0.8334	0.8872	0.8684	0.8491	0.8759	0.8808	0.8858	0.851	0.8734
Multimodal-CoT_base 2025.12	0.8275	0.8406	0.9235	0.8218	0.8275	0.8474	0.8579	0.8444	0.8531
LLaMA-Adapter 2025.12	0.8032	0.8437	0.883	0.8436	0.8372	0.869	0.8583	0.8405	0.8519
Chameleon (GPT-4) 2025.12	0.7764	0.8983	0.7413	0.8982	0.8827	0.9213	0.8803	0.8372	0.8654
GPT-4 w/ coT 2025.12	0.7149	0.8548	0.7244	0.9027	0.8265	0.9289	0.8666	0.7904	0.8399
Chameleon (ChatGPT) 2025.12	0.708	0.8162	0.7064	0.84	0.7977	0.8662	0.8186	0.7653	0.7993
ChatGPT w/ coT 2025.12	0.6792	0.7882	0.7098	0.8318	0.7737	0.8613	0.8072	0.7403	0.7831
GPT-3.5 w/ coT 2025.12	0.6743	0.7544	0.7087	0.7809	0.7468	0.7993	0.7823	0.6968	0.7517
GPT-3.5 2025.12	0.6728	0.7464	0.6974	0.76	0.7444	0.7742	0.768	0.6889	0.7397
UnifiedQA_base w/ coT 2025.12	0.6653	0.71	0.7604	0.7891	0.6642	0.8181	0.7706	0.6882	0.7411
VisualBERT 2025.12	0.6217	0.5933	0.6918	0.6118	0.6271	0.5854	0.6296	0.5992	0.6187
ViLT 2025.12	0.6138	0.6048	0.6389	0.6027	0.632	0.57	0.6072	0.619	0.6114
UnifiedQA_base 2025.12	0.6138	0.6816	0.6918	0.7491	0.6378	0.7784	0.7298	0.65	0.7012
Patch-TRM 2025.12	0.5528	0.6519	0.4679	0.6555	0.6696	0.6495	0.5804	0.675	0.6142
Top-Down 2025.12	0.5488	0.595	0.5433	0.6182	0.629	0.5979	0.5727	0.6216	0.5902
DFAF 2025.12	0.5449	0.6403	0.4882	0.6355	0.6588	0.6411	0.5712	0.6717	0.6072
BAN 2025.12	0.526	0.6088	0.4657	0.6664	0.6261	0.6551	0.5683	0.6394	0.5937
MCAN 2025.12	0.5117	0.5608	0.4623	0.5809	0.5943	0.554	0.5165	0.5972	0.5454
Random 2025.12	0.4008	0.4028	0.4613	0.2925	0.4745	0.3366	0.3935	0.4067	0.3983