Share your thoughts, 1 month free Claude Pro on usSee more

3D Question Answering on VSI-Bench

63.2Average Score

Loc3R-VLM

Updated 16d ago

Evaluation Results

Method
Loc3R-VLM 2026.03	63.2	68.9	47.3	64.9	61.2	62.1	82.4	44.9	73.8
VLM-3R 2026.03	60.9	70.2	49.4	69.2	67.1	65.4	80.5	45.4	40.1
TRACE 2026.03	60.15	47.55	38.82	73.9	45.62	63.85	61.7	58.01	72.97
CM 2026.03	59.72	46.7	41.43	72.49	50.14	63.69	58.62	55.5	72.61
LtM 2026.03	59.52	45.19	40.72	73.36	44.15	65.82	60.4	53.59	73.64
ToT 2026.03	58.88	44.55	42.12	72.2	45.55	65.35	57.83	55.62	73.73
CoT 2026.03	53.65	30.35	34.54	64.05	40.76	61.78	58.09	61.34	71.96
Direct 2026.03	52.61	33.77	32.57	67.09	42.99	62.54	50.52	51.03	70.71
VG-LLM-8B 2026.03	50.7	67.9	37.7	58.6	62	46.6	40.7	32.4	59.2
Qwen2.5-VL-7B 2026.04	50.7	67.1	38.3	65.8	53.5	51.7	57.3	41.2	29.8
Qwen2.5-VL-7B 2026.04	50	68.3	38.8	64.8	53	52.8	47.3	37.1	37.7
Qwen2.5-VL-3B 2026.04	49.3	67.5	39.3	63.5	54	50.3	55.8	36.6	27.2
Qwen2.5-VL-3B 2026.04	48.7	67.4	39.6	64	53.8	48.9	44.9	38.7	32.4
SpatialMLLM-4B 2026.03	48.4	65.3	34.8	63.1	45.1	41.3	46.2	33.5	46.3
Qwen2.5-VL-7B 2026.04	46.4	63.8	28.9	57	46.4	48.9	48	35.1	43.4
Gemini-1.5-Pro 2026.03	45.4	56.2	30.9	64.1	43.6	51.3	46.3	36	34.6
ViLaSR-7B 2026.03	45.4	63.5	34.4	60.6	30.9	48.9	45.2	30.4	49.2
Qwen2.5-VL-3B 2026.04	42.8	61.8	30.2	49.8	43.9	49.3	47.8	33.6	26.1
Struct2D (7B) 2026.03	41.9	46	34.7	56.4	42.6	35.1	44.9	33.5	-
TRACE 2026.03	41.42	33.27	31.51	58.67	41.56	39.44	35.33	28.87	51.29
SPAR-8B 2026.03	41.1	-	-	-	-	-	-	-	-
Direct 2026.03	39.79	36.02	29.84	52.38	42.95	40.14	33.78	31.44	47.41
TRACE 2026.03	39.38	22.05	28.03	59.98	38.99	40.85	37.4	31.96	42.56
ToT 2026.03	39.14	29.45	30.44	54.26	40.14	41.41	32.02	32.47	46.6
LtM 2026.03	38.34	35.09	24.47	48.22	44.48	43.1	30.79	35.05	49.5
ToT 2026.03	38.06	17.89	26.2	53.15	47.01	41.55	36.78	35.05	44.01
LtM 2026.03	38.01	23.27	31.39	54.49	38.68	42.96	34.71	29.9	36.73
CoT 2026.03	37.49	34.27	23.5	48.52	43.23	38.73	32.75	27.84	49.23
CM 2026.03	36.85	27.43	23.14	50.14	39.06	41.41	32.54	27.84	46.76
Qwen2.5-VL-7B 2026.04	36.6	41.5	21	50.5	36.7	38.6	41	29.4	34.5
Direct 2026.03	36.28	33.36	20.53	49.31	41.49	43.38	27.79	32.47	44.01
CM 2026.03	35.47	21.58	15.67	52.65	37.26	39.44	36.05	34.54	42.39
InternVL2-8B 2026.03	34.6	23.1	28.7	48.2	39.8	36.7	30.7	29.9	39.6
GPT-4o 2026.03	34	46.2	5.3	43.8	38.2	37	41.3	31.5	28.5
Qwen2.5-VL-7B 2026.03	33	40.9	14.8	43.4	10.7	38.6	38.5	33	29.8
CoT 2026.03	29.78	21.27	24.95	16.31	40.94	39.44	33.16	28.87	43.53
Qwen2.5-VL-3B 2026.04	27.9	25.2	17.4	16.5	26.2	37.2	45.4	28.4	27.3
SAT-LLaVA-Video-7B 2026.03	-	-	-	-	47.3	41.1	37.1	36.1	40.4