Share your thoughts, 1 month free Claude Pro on usSee more

3D Question Answering on SQA3D (EM, EM_R)

60.6Exact Match (EM)

GPT4Scene

Updated 1d ago

Evaluation Results

Method	Links
GPT4Scene 2026.03		60.6	63.3
V-LynX-7B 2026.05		60.5	62.6
PAVE-7B 2026.05		59	61.4
LLaVA-OV-7B-FT 2026.05		55.8	58.1
LLaVA-3D-7B 2026.05		55.6	57.6
Chat-Scene 2026.03		54.4	57.2
FastV 2026.04		54.22	56.77
Scene-LLM-7B 2026.05		54.2	-
DVTIE 2026.04		54.07	56.64
DVTIE 2026.04		54.01	56.43
Baseline (Chat-Scene) 2026.04		53.98	56.8
Fast3D 2026.04		53.95	56.49
Fast3D 2026.04		53.55	56.25
FastV 2026.04		53.27	55.91
DVTIE 2026.04		53.09	55.55
Random Pruning 2026.04		52.74	55.28
ToMe 2026.04		52.64	55.12
Fast3D 2026.04		52.59	55.04
ToMe 2026.04		52.22	54.81
V-LynX-0.5B 2026.05		52.2	54.2
PAVE-0.5B 2026.05		51.1	52.8
Random Pruning 2026.04		51.02	53.41
LEO-7B 2026.05		50	52.4
3D-LLM-7B 2026.05		49.8	-
LEO 2026.03		49.4	52.2
Random Pruning 2026.04		48.48	50.99
FastV 2026.04		48.16	50.76
ToMe 2026.04		47.83	50.31
3D-LLM 2026.03		47.8	49.6
Chat-3D v2 2026.03		45	48.1
LLaVA-OV-0.5B-FT 2026.05		44.1	45.7
VideoChat2-7B 2026.05		37.3	-
LLaVA-OV-7B 2026.05		8.3	-
LLaVA-OV-0.5B 2026.05		0.8	43