Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on ScienceQA (test)

98.2Accuracy

IVC-Prune

Updated 13d ago

Evaluation Results

Method
IVC-Prune 2026.02	98.2	-	-	-	-	-	-	-	-	100	-
Vanilla 2026.02	98.1	-	-	-	-	-	-	-	-	100	-
PDrop 2026.02	97.9	-	-	-	-	-	-	-	-	99.1	-
FastV 2026.02	97.4	-	-	-	-	-	-	-	-	98.6	-
Vanilla 2026.02	96.9	-	-	-	-	-	-	-	-	100	-
PDrop 2026.02	96.8	-	-	-	-	-	-	-	-	100	-
IVC-Prune 2026.02	96.8	-	-	-	-	-	-	-	-	100.1	-
FastV 2026.02	96.3	-	-	-	-	-	-	-	-	98.8	-
SMoLA-PaLI-X_FT (Specialist) 2023.12	94.7	-	-	-	-	-	-	-	-	-	-
SOTA [58] 2023.12	92.7	-	-	-	-	-	-	-	-	-	-
CogVLM-Chat 2023.11	91.2	-	-	-	-	-	-	-	-	-	-
Dense Baseline 2026.04	91.09	90.99	94.94	88.18	90.03	88.45	90.73	-	-	-	-
Q-VLM 2024.10	89.81	-	-	-	-	-	-	-	-	-	11.2
Dense Baseline 2026.04	89.6	89.43	95.61	85.09	88.61	87.41	88.15	-	-	-	-
Q-VLM 2024.10	89.58	-	-	-	-	-	-	-	-	-	8.3
ZeroQuant-V2 2024.10	89.13	-	-	-	-	-	-	-	-	-	12.6
ZeroQuant-V2 2024.10	89.04	-	-	-	-	-	-	-	-	-	10.7
Vanilla 2026.02	88.7	-	-	-	-	-	-	-	-	100	-
Human 2023.03	88.4	90.23	84.97	87.48	89.6	87.5	88.1	91.59	82.42	-	-
PDrop 2026.02	87.5	-	-	-	-	-	-	-	-	98	-
IVC-Prune 2026.02	87	-	-	-	-	-	-	-	-	100.2	-
Unified-IO2 2023.11	86.2	-	-	-	-	-	-	-	-	-	-
FastV 2026.02	85.8	-	-	-	-	-	-	-	-	98.2	-
LLaMA-Adapter 2023.03	85.19	84.37	88.3	84.36	83.72	80.32	86.9	85.83	84.05	-	-
MM-CoT 2023.03	84.91	87.52	77.17	85.82	87.88	82.9	86.83	84.65	85.37	-	-
QAPruner 2026.04	84.72	83.08	92.13	82.09	82.16	81.61	84.6	-	-	-	-
QVLM 2026.04	84.39	82.9	91.34	81.82	81.82	80.91	84.6	-	-	-	-
QAPruner 2026.04	84.27	82.99	90.33	82	82.26	80.66	84.6	-	-	-	-
With Prune 2026.04	84.06	82.95	89.43	82	82.06	80.22	84.6	-	-	-	-
GPT-4 2023.03	83.99	85.48	72.44	90.27	82.65	71.49	92.89	86.66	79.04	-	-
With Prune 2026.04	82.69	82.19	84.93	81.91	81.62	77.34	84.6	-	-	-	-
QAPruner 2026.04	80.95	78.69	90.55	77.82	77.22	78.98	80.77	-	-	-	-
QAPruner 2026.04	80.85	79.4	88.08	78	78.25	78.78	80.77	-	-	-	-
Q-VLM 2024.10	80.78	-	-	-	-	-	-	-	-	-	8.9
QVLM 2026.04	80.36	77.62	89.99	78.18	75.95	77.74	80.77	-	-	-	-
Q-VLM 2024.10	79.79	-	-	-	-	-	-	-	-	-	6.1
With Prune 2026.04	79.75	77.62	87.63	77.73	75.9	76.45	80.77	-	-	-	-
ZeroQuant-V2 2024.10	78.81	-	-	-	-	-	-	-	-	-	9.7
With Prune 2026.04	78.61	77.58	82.34	77.73	75.76	74.07	80.77	-	-	-	-
ChatGPT 2023.03	78.31	78.82	70.98	83.18	77.37	67.92	86.13	80.72	74.03	-	-
LLaMA-Adapter 2023.03	78.31	79	73.79	80.55	78.3	70.35	83.14	79.77	75.68	-	-
ZeroQuant-V2 2024.10	78.08	-	-	-	-	-	-	-	-	-	7.3
LLaVA-FA-3B 2026.01	77	-	-	-	-	-	-	-	-	-	-
MiniCPM-V-2 2026.01	76.3	-	-	-	-	-	-	-	-	-	-
LLaVA-FA-7B 2026.01	76	-	-	-	-	-	-	-	-	-	-
MiniCPM-V 2026.01	74.4	-	-	-	-	-	-	-	-	-	-
UnifiedQA 2023.03	74.11	71	76.04	78.91	66.42	66.53	81.81	77.06	68.82	-	-
Deepseek-VL-7B 2026.01	74	-	-	-	-	-	-	-	-	-	-
LLaVA-NeXT 2026.01	73.6	-	-	-	-	-	-	-	-	-	-
Imp-3B 2026.01	72.8	-	-	-	-	-	-	-	-	-	-
LLaVA-1.5 2023.11	71.6	-	-	-	-	-	-	-	-	-	-
Bunny-3B 2026.01	70.9	-	-	-	-	-	-	-	-	-	-
SPHINX-2k 2023.11	70.6	-	-	-	-	-	-	-	-	-	-
MM-CoT 2023.03	70.53	71.09	70.75	69.18	71.16	65.84	71.57	71	69.68	-	-
UnifiedQA 2023.03	70.12	68.16	69.18	74.91	63.78	61.38	77.84	72.98	65	-	-
MobileVLMv2 2026.01	70	-	-	-	-	-	-	-	-	-	-
VILA-3B 2026.01	69	-	-	-	-	-	-	-	-	-	-
Qwen-VL-Chat 2023.11	68.8	-	-	-	-	-	-	-	-	-	-
mPLUG-Owl2 2023.11	68.7	-	-	-	-	-	-	-	-	-	-
MoE-LLaVA-3B 2026.01	68.5	-	-	-	-	-	-	-	-	-	-
VILA-7B 2026.01	68.2	-	-	-	-	-	-	-	-	-	-
Qwen-VL-Chat 2026.01	68.2	-	-	-	-	-	-	-	-	-	-
LLaVA-FA-2B 2026.01	68.2	-	-	-	-	-	-	-	-	-	-
Dense Baseline 2026.04	67.79	66.3	70.75	68.45	66.23	65.49	68.5	-	-	-	-
LLaVA-1.5 2023.11	66.8	-	-	-	-	-	-	-	-	-	-
LLaVA-1.5-7B 2026.01	66.8	-	-	-	-	-	-	-	-	-	-
Vanilla 2026.02	66.4	-	-	-	-	-	-	-	-	100	-
IVC-Prune 2026.02	66.4	-	-	-	-	-	-	-	-	101.3	-
FastV 2026.02	66.3	-	-	-	-	-	-	-	-	99.7	-
PDrop 2026.02	66.3	-	-	-	-	-	-	-	-	99.8	-
Imp-2B 2026.01	66.1	-	-	-	-	-	-	-	-	-	-
CogVLM 2026.01	65.6	-	-	-	-	-	-	-	-	-	-
Bunny-2B 2026.01	64.6	-	-	-	-	-	-	-	-	-	-
DeepSeek-VL-1.3B 2026.01	64.2	-	-	-	-	-	-	-	-	-	-
InstructBLIP 2026.01	63.1	-	-	-	-	-	-	-	-	-	-
Mini-Gemini-2B 2026.01	63.1	-	-	-	-	-	-	-	-	-	-
MoE-LLaVA-2B 2026.01	63.1	-	-	-	-	-	-	-	-	-	-
VisualBERT 2023.03	61.87	59.33	69.18	61.18	62.71	62.17	58.54	62.96	59.92	-	-
IDEFICS-Instruct 2023.11	61.8	-	-	-	-	-	-	-	-	-	-
QAPruner 2026.04	61.59	61.06	66.14	59	60.61	62.07	59.16	-	-	-	-
LLaVA-FA-1B 2026.01	61.3	-	-	-	-	-	-	-	-	-	-
QAPruner 2026.04	61.24	61.06	64.12	59.27	60.56	61.33	59.16	-	-	-	-
With Prune 2026.04	61.05	60.57	64.57	59.18	60.07	60.93	59.16	-	-	-	-
BLIP-2 2026.01	61	-	-	-	-	-	-	-	-	-	-
MobileVLM 2026.01	61	-	-	-	-	-	-	-	-	-	-
With Prune 2026.04	60.65	60.44	62.99	59.18	59.43	60.09	59.16	-	-	-	-
QVLM 2026.04	60.62	60.12	64	58.91	59.38	60.04	59.16	-	-	-	-
InstructBLIP 2023.11	60.5	-	-	-	-	-	-	-	-	-	-
MCAN 2023.03	54.54	56.08	46.23	58.09	59.43	51.17	55.4	51.65	59.72	-	-
CLIP 2025.12	51.85	-	-	-	-	-	-	-	-	-	-
ViLT 2025.12	49.33	-	-	-	-	-	-	-	-	-	-
ViLT 2025.12	47.05	-	-	-	-	-	-	-	-	-	-
OpenFlamingo 2023.11	44.8	-	-	-	-	-	-	-	-	-	-
ViLT 2025.12	44.52	-	-	-	-	-	-	-	-	-	-
Dual-Encoder 2025.12	43.57	-	-	-	-	-	-	-	-	-	-
ViLT 2025.12	42.78	-	-	-	-	-	-	-	-	-	-
ViLT 2025.12	42.58	-	-	-	-	-	-	-	-	-	-
CLIP 2025.12	40.75	-	-	-	-	-	-	-	-	-	-
Random Choice 2023.03	39.83	40.28	46.13	29.25	47.45	40.08	33.66	39.35	40.67	-	-
MiniGPT-4 2023.11	39.6	-	-	-	-	-	-	-	-	-	-

Showing 100 of 113 rows