Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Understanding on Standard Multimodal Evaluation Suite 1.5 (test val)

63.2GQA Score

LLaVA-1.5-13B

Updated 6d ago

Evaluation Results

Method	Links
LLaVA-1.5-13B 2025.03		63.2	67.7	1,818	61.3	72.8	80	100
LLaVA-1.5-13B 2025.03		63.2	67.7	1,818	61.3	72.8	80	100
TwigVLM++ 2025.03		62.6	68.2	1,829	60.4	73.2	79.4	99.8
TwigVLM++ 2025.03		62.6	68.2	1,829	60.4	73.2	79.4	99.8
TwigVLM 2025.03		62.5	68.6	1,840	60.4	73.1	79.4	99.9
TwigVLM 2025.03		62.5	68.6	1,840	60.4	73.1	79.4	99.9
TwigVLM++ 2025.03		62.3	67.7	1,849	60.3	72.9	79.1	99.6
TwigVLM++ 2025.03		62.3	67.7	1,849	60.3	72.9	79.1	99.6
VisionZip‡ 2025.03		61.6	67.1	1,790	59.9	72.7	78.6	98.5
VisionZip‡ 2025.03		61.6	67.1	1,790	59.9	72.7	78.6	98.5
TwigVLM 2025.03		61.2	66.9	1,811	60.2	73.4	79.1	98.9
TwigVLM 2025.03		61.2	66.9	1,811	60.2	73.4	79.1	98.9
TwigVLM++ 2025.03		61	65.7	1,793	58.5	72.7	78	97.5
TwigVLM++ 2025.03		61	65.7	1,793	58.5	72.7	78	97.5
FastV 2025.03		60.3	67.4	1,807	60.4	74	77.7	98.6
FastV 2025.03		60.3	67.4	1,807	60.4	74	77.7	98.6
VisionZip‡ 2025.03		60.1	67.6	1,736	59.2	73	77.6	97.4
VisionZip‡ 2025.03		60.1	67.6	1,736	59.2	73	77.6	97.4
TwigVLM 2025.03		60	67.4	1,765	58.4	72.4	77	97.1
TwigVLM 2025.03		60	67.4	1,765	58.4	72.4	77	97.1
VisionZip 2025.03		59.1	66.9	1,754	59.5	73.5	78.1	97.4
VisionZip 2025.03		59.1	66.9	1,754	59.5	73.5	78.1	97.4
VisionZip‡ 2025.03		58.1	65.6	1,671	58.5	72.3	75.2	94.9
VisionZip‡ 2025.03		58.1	65.6	1,671	58.5	72.3	75.2	94.9
VisionZip 2025.03		57.9	66.7	1,743	58.7	74	76.8	96.6
VisionZip 2025.03		57.9	66.7	1,743	58.7	74	76.8	96.6
FastV 2025.03		57.5	65.9	1,758	58	73.8	74.3	95.7
FastV 2025.03		57.5	65.9	1,758	58	73.8	74.3	95.7
VisionZip 2025.03		56.2	64.9	1,676	57.4	74.4	73.7	94.2
VisionZip 2025.03		56.2	64.9	1,676	57.4	74.4	73.7	94.2
FastV 2025.03		50.1	55.9	1,408	52.2	73.2	61.1	83.6
FastV 2025.03		50.1	55.9	1,408	52.2	73.2	61.1	83.6