Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on VizWiz

100Accuracy

Vanilla

Updated 2d ago

Evaluation Results

Method
Vanilla 2026.04	100	-	-	-	50	100
RCP 2026.04	99.06	-	-	-	50.39	100.78
VisionZip 2026.04	98.75	-	-	-	51.6	103.2
DART 2026.04	98.57	-	-	-	51.1	102.2
PDrop 2026.04	97.07	-	-	-	51.1	102.2
RCP 2026.04	96.73	-	-	-	50.1	100.2
HiRED 2026.04	96.53	-	-	-	50.1	100.2
HiRED 2026.04	95.2	-	-	-	51.3	102.6
PDrop 2026.04	95.08	-	-	-	51	102
RCP 2026.04	95	-	-	-	49.94	99.88
VisionZip 2026.04	94.81	-	-	-	52.9	105.8
DART 2026.04	94.4	-	-	-	51.6	103.2
HiRED 2026.04	91.46	-	-	-	50.2	100.4
FastV 2026.04	88.71	-	-	-	50.8	101.6
CoGR-MoE 2026.04	84.8	-	-	-	-	-
FastV 2026.04	82.86	-	-	-	51.3	102.6
ToMe 2026.04	82.75	-	-	-	50.5	101
I2MoE 2026.04	82.4	-	-	-	-	-
AdaMerging 2026.03	81	-	-	-	-	-
MoME 2026.04	81	-	-	-	-	-
CL-MOE 2026.04	80.9	-	-	-	-	-
TARA-Variant B 2026.03	79.2	-	-	-	-	-
Qwen-VL 2024.07	78.8	-	-	-	-	-
TARA-Variant A 2026.03	78.7	-	-	-	-	-
Metis-HOME 2026.04	78.5	-	-	-	-	-
Qwen-VL-Chat 2024.07	78.2	-	-	-	-	-
KnOTS-TIES 2026.03	77	-	-	-	-	-
MH-MoE 2026.04	77	-	-	-	-	-
FP16 2024.12	76	-	-	-	78.1	-
PDrop 2026.04	75.89	-	-	-	50.7	101.4
DualPD 2026.01	75.8	-	-	-	-	-
MBQ 2024.12	75.6	-	-	-	77.6	-
AWQ 2024.12	75.4	-	-	-	77.5	-
RTN 2024.12	74.8	-	-	-	75	-
DualPD 2026.01	74.72	-	-	-	-	-
AutoV 2025.06	74.4	-	-	-	-	-
DoLA 2026.01	74.38	-	-	-	-	-
Qwen-2.5-VL-7B 2026.01	74.11	-	-	-	-	-
FastV 2026.04	73.88	-	-	-	50.8	101.6
GPTQ 2024.12	73.6	-	-	-	76.6	-
MBQ 2024.12	73.6	-	-	-	75.8	-
ToMe 2026.04	73.34	-	-	-	50.2	100.4
DoLA 2026.01	73.05	-	-	-	-	-
Qwen-2-VL-7B 2026.01	72.73	-	-	-	-	-
API 2025.06	72.1	-	-	-	-	-
PaLI-17B 2023.11	71.6	-	-	-	-	-
MASQuant 2026.03	71.5	-	-	-	-	-
RTN 2024.12	71.3	-	-	-	73.2	-
TA 2026.03	71.3	-	-	-	-	-
LocoRE 2026.01	71.2	-	-	-	-	-
AuroraEdge-V-2B 2026.01	71.05	-	-	-	-	-
GIT2 2023.11	71	-	-	-	-	-
PALI-X-55B 2023.08	70.9	-	-	-	-	-
PaLI-X-55B 2023.10	70.9	-	-	-	-	-
Qwen2.5-VL-32B 2026.01	70.8	-	-	-	-	-
FGVP 2025.06	70.8	-	-	-	-	-
Dense 2026.03	70.8	-	-	-	-	-
FP16 2026.05	70.8	-	-	-	-	-
AWQ 2026.03	70.6	-	-	-	-	-
MBQ 2026.03	70.6	-	-	-	-	-
MBQ 2026.03	70.6	-	-	-	-	-
MASQuant 2026.03	70.6	-	-	-	-	-
Baseline 2026.05	70.58	-	-	-	-	-
RTN 2026.03	70.5	-	-	-	-	-
Qwen2.5-VL 7B, Dense 2026.03	70.48	-	-	-	-	-
Qwen2.5-VL-7B 2025.08	70.4	-	-	-	-	-
Qwen2.5-VL-3B 2026.01	70.35	-	-	-	-	-
FastV + RotateK 2026.05	70.32	-	-	-	-	-
VisionZip + RotateK 2026.05	70.13	-	-	-	-	-
SQ 2026.03	70	-	-	-	-	-
TIES 2026.03	69.8	-	-	-	-	-
SQ 2024.12	69.7	-	-	-	72.2	-
Finetuned 2026.03	69.7	-	-	-	-	-
Base 2025.06	69.5	-	-	-	-	-
FastV + ThinK 2026.05	69.25	-	-	-	-	-
FP16 2024.12	69.2	-	-	-	74.3	-
Circle 2025.06	69.2	-	-	-	-	-
HiPrune 2025.08	69.2	-	-	-	-	-
FastV (token only) 2026.05	69.13	-	-	-	-	-
Dense 2026.03	69.1	-	-	-	-	-
FP16 2026.05	69.1	-	-	-	-	-
MBQ 2024.12	69	-	-	-	73.6	-
HiPrune++ 2025.08	69	-	-	-	-	-
VisionZip (token only) 2026.05	68.97	-	-	-	-	-
VisionZip + ThinK 2026.05	68.93	-	-	-	-	-
Qwen2.5-VL-3B 2025.08	68.9	-	-	-	-	-
SplitQ 2026.05	68.7	-	-	-	-	-
MBQ 2026.03	68.6	-	-	-	-	-
LLaVA-1.5-7B 2026.04	68.6	-	-	-	-	-
HiPrune 2025.08	68.6	-	-	-	-	-
HiPrune++ 2025.08	68.5	-	-	-	-	-
TLQ 2026.02	68.4	-	-	-	-	-
AutoV 2025.06	68.4	-	-	-	-	-
SplitQ 2026.05	68.4	-	-	-	-	-
FP16 Baseline 2026.03	68.34	-	-	-	-	-
Qwen2-VL 7B 2026.03	68.33	-	-	-	-	100
GPTQ 2024.12	68.3	-	-	-	72.3	-
Qwen2-VL-7b 2026.02	68.3	-	-	-	-	-
MBQ 2026.02	68.3	-	-	-	-	-
fp16 2026.02	68.3	-	-	-	-	-

Showing 100 of 1873 rows

...