Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Evaluation on SEED-Bench

77.3Accuracy

D2Dloc

Updated 6d ago

Evaluation Results

Method
D2Dloc 2025.07	77.3	-	-	-	-
Jigsaw 2025.12	77.01	-	-	-	-
D2Djus 2025.07	77	-	-	-	-
ViCrit 2025.12	76.64	-	-	-	-
D2Iloc 2025.07	76.6	-	-	-	-
Qwen2.5-VL-7B w/ GRPO 2025.07	76.5	-	-	-	-
D2Dpar 2025.07	76.5	-	-	-	-
D2Ijus 2025.07	76.4	-	-	-	-
Mix + CL + CARE 2025.12	76.38	-	-	-	-
GRPO-CARE 2025.12	76.36	-	-	-	-
Qwen2.5-VL-7B w/ GRPO† 2025.07	76.3	-	-	-	-
InternVL2-8B 2025.09	76.1	-	-	-	-
D2Ipar 2025.07	76.1	-	-	-	-
Rotation + CL + CARE 2025.12	76.05	-	-	-	-
Qwen2.5-VL-7B* 2025.07	75.6	-	-	-	-
Qwen 2.5 VL 2025.12	75.48	-	-	-	-
VisualSphinx 2025.12	75.47	-	-	-	-
Vision-Zero 2025.12	75.45	-	-	-	-
Jigsaw + CARE 2025.12	75.34	-	-	-	-
Jigsaw + CL + CARE 2025.12	75.17	-	-	-	-
PTP 2025.09	75.1	-	-	-	-
Qwen2-VL-7B 2025.07	75.1	-	-	-	-
Visual Jigsaw 2025.12	74.8	-	-	-	-
Jigsaw + CL 2025.12	74.64	-	-	-	-
PatchFit + CL + CARE 2025.12	73.97	-	-	-	-
GPT-4o 2025.07	72	-	-	-	-
Full Finetune 2025.03	71.8	-	-	-	-
InternVL2-2B 2025.09	70.9	-	-	-	-
PTP 2025.09	70.7	-	-	-	-
LongVILA-7B (S3) 2024.08	70.6	-	-	-	-
Ours 2025.10	69.74	-	-	-	53.62
Ours 2025.10	69.52	-	-	-	53.01
AGLA 2025.10	69.27	-	-	-	51.48
VCD 2025.10	68.76	-	-	-	52.31
PreSel 2025.03	68.5	-	-	-	-
Vanilla 2025.10	68.48	-	-	-	52.06
Random 2025.03	68.3	-	-	-	-
AGLA 2025.10	68.11	-	-	-	51.65
Full Finetune 2025.03	68	-	-	-	-
LLaVolta 2024.06	66.7	-	-	-	-
VCD 2025.10	66.52	-	-	-	49.69
Ours 2025.10	66.51	-	-	-	49.66
R1-Onevision-7B 2025.07	66.5	-	-	-	-
Vanilla 2025.10	66.26	-	-	-	49.54
LLaVolta 2024.06	66.1	-	-	-	-
LLaVolta 2024.06	65.9	-	-	-	-
LLaVolta 2024.06	65.6	-	-	-	-
LLaVolta 2024.06	65.4	-	-	-	-
LLaVolta 2024.06	65.3	-	-	-	-
Random 2025.03	65	-	-	-	-
PreSel 2025.03	65	-	-	-	-
LLaVolta 2024.06	64.9	-	-	-	-
CGD 2025.10	63.23	-	-	-	46.58
AGLA 2025.10	63.01	-	-	-	45.95
SIMA 2024.05	63	-	-	-	-
VILA 2024.08	62.8	-	-	-	-
VILA-13B 2023.06	62.8	-	-	-	-
SIMA 2024.05	62.5	-	-	-	-
GT-DPO 2024.05	62.2	-	-	-	-
VILA-13B-AWQ 2023.06	62.2	-	-	-	-
GT-DPO 2024.05	61.9	-	-	-	-
VILA-7B 2023.06	61.7	-	-	-	-
LLaVA-1.5 2024.08	61.6	-	-	-	-
LLaVA-1.5-13B 2024.05	61.6	-	-	-	-
mPLUG-Owl2 2024.08	61.6	-	-	-	-
VILA-7B-AWQ 2023.06	61.3	-	-	-	-
OneLLM-7B 2023.12	61.2	-	-	-	-
VILA 2024.08	61.1	-	-	-	-
VILA-7B 2024.05	61.1	-	-	-	-
SIMA 2024.05	60.6	-	-	-	-
GT-DPO 2024.05	60.4	-	-	-	-
POVID 2024.05	60.3	-	-	-	-
HA-DPO 2024.05	60.2	-	-	-	-
FAST 2024.08	60.1	-	-	-	-
RLHF 2024.05	60	-	-	-	-
VCD 2025.10	59.98	-	-	-	42.87
Vanilla 2025.10	59.76	-	-	-	42.61
Chain of Spot 2024.08	59.7	-	-	-	-
LLaVA-1.5 2024.10	58.8	66.5	37.4	37.2	-
TGA 2024.10	58.7	66.3	37.4	37.7	-
LLaVA-1.5 2024.08	58.6	-	-	-	-
LLaVA-1.5-7B 2024.05	58.6	-	-	-	-
LLaVA-v1.5 2023.12	58.6	-	-	-	-
LLaVA-v1.5 2024.08	58.6	-	-	-	-
LLaVA-1.5 2024.10	58.6	66.1	37.3	37	-
InstructBLIP 2024.08	58.2	-	-	-	-
Qwen-VL-Chat 2024.08	58.2	-	-	-	-
Qwen-VL 2023.12	58.2	-	-	-	-
Qwen-VL-Chat 2024.08	58.2	-	-	-	-
Qwen-VL-chat 2024.10	58.2	65.4	37.8	36.8	-
Qwen-VL 2024.08	56.3	-	-	-	-
LLaVA-1.5-7B 2025.03	55.6	-	-	-	-
COINCIDE 2025.03	53.9	-	-	-	-
GPT-4V 2025.07	53.8	-	-	-	-
PreSel 2025.03	53.5	-	-	-	-
InstructBLIP 2024.08	53.4	-	-	-	-
InstructBLIP 2024.08	53.4	-	-	-	-
InstructBlip 2024.10	53.4	58.8	38.1	-	-
EL2N 2025.03	49.2	-	-	-	-
Random 2025.03	48.3	-	-	-	-

Showing 100 of 112 rows