Share your thoughts, 1 month free Claude Pro on usSee more

Open-Ended Visual Question Answering on Delta-SECOND

32.74H-CQS METEOR

Delta-LLaVA

Updated 3d ago

Evaluation Results

Method	Links
Delta-LLaVA 2026.04		32.74	41.45	27.77	45	30.31	42.8	31.93	54.01	29.49	40.25	29.91	37.16
LISA 2026.04		28.64	32.13	23.77	35.92	26.58	41.88	29.96	43.43	25.29	33.84	25.53	33.58
LISAT 2026.04		27.71	37.07	23.88	40.21	26.35	40.71	29.59	45.99	25.27	33.73	25.15	31.67
OMG-LLaVA 2026.04		26.8	37.06	22.86	34.73	23.87	41.26	28.45	44.73	26.55	32.98	23.89	30.97
PSALM 2026.04		24.32	28.45	21.43	32.59	22.73	38.63	26.18	42.85	23.6	31.52	21.36	29.41
GPT-4.1 2026.04		16.4	28.02	15.77	30.26	14.21	28.77	17.22	32.3	16.8	27.61	15.13	25.38
Gemini 2.5 Flash 2026.04		16.18	27.21	13.89	29.64	14.6	27.51	17.15	30.45	15.35	30.74	15.67	26.19
GPT-4o 2026.04		15.79	26.98	18.25	28.03	14.89	26.08	15.83	31.15	18.57	29.11	15.14	24.23
Qwen3-VL 8B 2026.04		15.47	24.11	15.7	24.38	14.76	23.1	15.6	22.92	16.57	21.17	15.24	21.78
EVOL-SAM3 2026.04		14.51	20.63	13.44	20.42	15.59	20.22	14.56	20.59	14.88	20.18	14.55	20.17
Qwen2.5-VL 7B 2026.04		13.26	22.4	16.58	20.03	11.81	22.85	13.52	20.36	16.61	20.04	11.87	20.07
InternVL3 8B 2026.04		11.21	24.35	12.83	24.82	14.69	22.51	15.42	24.65	14.5	23.19	14.75	21.97
InternVL2.5 8B 2026.04		10.44	22.06	10.57	23.19	13.26	21.74	12.21	24.21	15.49	22.01	13.28	20.89