Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on VizWiz

100Accuracy

Vanilla

Updated 3d ago

Evaluation Results

Method
Vanilla 2026.04	100	-	-	-	50	100
RCP 2026.04	99.06	-	-	-	50.39	100.78
VisionZip 2026.04	98.75	-	-	-	51.6	103.2
DART 2026.04	98.57	-	-	-	51.1	102.2
PDrop 2026.04	97.07	-	-	-	51.1	102.2
RCP 2026.04	96.73	-	-	-	50.1	100.2
HiRED 2026.04	96.53	-	-	-	50.1	100.2
HiRED 2026.04	95.2	-	-	-	51.3	102.6
PDrop 2026.04	95.08	-	-	-	51	102
RCP 2026.04	95	-	-	-	49.94	99.88
VisionZip 2026.04	94.81	-	-	-	52.9	105.8
DART 2026.04	94.4	-	-	-	51.6	103.2
HiRED 2026.04	91.46	-	-	-	50.2	100.4
FastV 2026.04	88.71	-	-	-	50.8	101.6
FastV 2026.04	82.86	-	-	-	51.3	102.6
ToMe 2026.04	82.75	-	-	-	50.5	101
AdaMerging 2026.03	81	-	-	-	-	-
TARA-Variant B 2026.03	79.2	-	-	-	-	-
Qwen-VL 2024.07	78.8	-	-	-	-	-
TARA-Variant A 2026.03	78.7	-	-	-	-	-
Qwen-VL-Chat 2024.07	78.2	-	-	-	-	-
KnOTS-TIES 2026.03	77	-	-	-	-	-
FP16 2024.12	76	-	-	-	78.1	-
PDrop 2026.04	75.89	-	-	-	50.7	101.4
DualPD 2026.01	75.8	-	-	-	-	-
MBQ 2024.12	75.6	-	-	-	77.6	-
AWQ 2024.12	75.4	-	-	-	77.5	-
RTN 2024.12	74.8	-	-	-	75	-
DualPD 2026.01	74.72	-	-	-	-	-
AutoV 2025.06	74.4	-	-	-	-	-
DoLA 2026.01	74.38	-	-	-	-	-
Qwen-2.5-VL-7B 2026.01	74.11	-	-	-	-	-
FastV 2026.04	73.88	-	-	-	50.8	101.6
GPTQ 2024.12	73.6	-	-	-	76.6	-
MBQ 2024.12	73.6	-	-	-	75.8	-
ToMe 2026.04	73.34	-	-	-	50.2	100.4
DoLA 2026.01	73.05	-	-	-	-	-
Qwen-2-VL-7B 2026.01	72.73	-	-	-	-	-
API 2025.06	72.1	-	-	-	-	-
PaLI-17B 2023.11	71.6	-	-	-	-	-
MASQuant 2026.03	71.5	-	-	-	-	-
RTN 2024.12	71.3	-	-	-	73.2	-
TA 2026.03	71.3	-	-	-	-	-
LocoRE 2026.01	71.2	-	-	-	-	-
AuroraEdge-V-2B 2026.01	71.05	-	-	-	-	-
GIT2 2023.11	71	-	-	-	-	-
PALI-X-55B 2023.08	70.9	-	-	-	-	-
PaLI-X-55B 2023.10	70.9	-	-	-	-	-
Qwen2.5-VL-32B 2026.01	70.8	-	-	-	-	-
FGVP 2025.06	70.8	-	-	-	-	-
Dense 2026.03	70.8	-	-	-	-	-
AWQ 2026.03	70.6	-	-	-	-	-
MBQ 2026.03	70.6	-	-	-	-	-
MBQ 2026.03	70.6	-	-	-	-	-
MASQuant 2026.03	70.6	-	-	-	-	-
RTN 2026.03	70.5	-	-	-	-	-
Qwen2.5-VL 7B, Dense 2026.03	70.48	-	-	-	-	-
Qwen2.5-VL-3B 2026.01	70.35	-	-	-	-	-
SQ 2026.03	70	-	-	-	-	-
TIES 2026.03	69.8	-	-	-	-	-
SQ 2024.12	69.7	-	-	-	72.2	-
Finetuned 2026.03	69.7	-	-	-	-	-
Base 2025.06	69.5	-	-	-	-	-
FP16 2024.12	69.2	-	-	-	74.3	-
Circle 2025.06	69.2	-	-	-	-	-
Dense 2026.03	69.1	-	-	-	-	-
MBQ 2024.12	69	-	-	-	73.6	-
MBQ 2026.03	68.6	-	-	-	-	-
TLQ 2026.02	68.4	-	-	-	-	-
AutoV 2025.06	68.4	-	-	-	-	-
FP16 Baseline 2026.03	68.34	-	-	-	-	-
Qwen2-VL 7B 2026.03	68.33	-	-	-	-	100
GPTQ 2024.12	68.3	-	-	-	72.3	-
Qwen2-VL-7b 2026.02	68.3	-	-	-	-	-
MBQ 2026.02	68.3	-	-	-	-	-
fp16 2026.02	68.3	-	-	-	-	-
RTN 2026.03	68.2	-	-	-	-	-
MASQuant 2026.03	68.2	-	-	-	-	-
AWQ 2026.03	68.1	-	-	-	-	-
GIT 2023.11	68	-	-	-	-	-
MBQ 2026.03	68	-	-	-	-	-
SQ 2026.03	68	-	-	-	-	-
RTN 2026.03	67.8	-	-	-	-	-
GPTQ 2026.03	67.73	-	-	-	-	-
MASQuant 2026.03	67.7	-	-	-	-	-
Upper bound 2025.12	67.23	-	-	-	-	-
QIG 2026.03	67.12	-	-	-	-	-
Qwen2-VL-2B 2026.01	66.96	-	-	-	-	-
API 2025.06	66.9	-	-	-	-	-
MBQ 2026.03	66.62	-	-	-	-	-
MASQuant 2026.03	66.4	-	-	-	-	-
AWQ 2026.03	66.24	-	-	-	-	-
FP16 2024.12	66.2	-	-	-	74.6	-
PALI-X-55B 2023.07	66.1	-	-	-	-	-
RTN 2024.12	66.1	-	-	-	72.1	-
fp16 2026.02	66	-	-	-	-	-
SQ 2024.12	65.7	-	-	-	70.3	-
MBQ 2024.12	65.7	-	-	-	70.8	-
InternVL2-26B 2026.03	65.65	-	-	-	-	-
SparseGPT 2026.03	65.28	-	-	-	-	-

Showing 100 of 1565 rows

...