Our new X account is live! Follow @wizwand_team for updates

Embodied Task Planning on VoTa-Bench 1.0 (Unseen)

82.27Examine&Light SR

D2PO

Updated 4d ago

Evaluation Results

Method	Links
D2PO 2025.03		82.27	66.47	64.47	55.34	7.14	5.69	53.1	51.52	58.09	57.59	57.8	55.79	57.59	52.27
D2PO 2025.03		77.3	62.67	56.58	49.56	11.43	8.66	55.75	55.75	72.79	72.79	68.81	68.51	61.46	57.16
D2PO 2025.03		77.3	58.98	60.53	49.3	14.29	10.38	60.18	60.18	69.12	68.9	65.14	64.46	61.61	55.78
DPO 2025.03		75.89	51.53	60.53	45.25	7.14	4.62	56.64	56.21	65.44	64.61	63.3	63.12	58.82	51.23
DPO 2025.03		74.47	61.4	64.47	54.16	7.14	5.63	45.13	43.76	51.47	50.33	53.21	51.41	52.32	47.39
DPO 2025.03		73.76	60.17	53.95	46.95	7.14	5.15	52.21	52.21	66.18	66.18	66.97	66.97	57.59	53.65
LLaMA-3.2 (11B) 2025.03		70.92	58.75	53.95	46.25	7.14	4.61	51.33	50.02	47.06	46.85	52.29	50.81	50.31	46.02
Qwen2-VL (7B) 2025.03		68.79	56.93	52.63	44.46	4.29	2.61	43.36	43.37	62.5	62.29	49.54	47.38	50.77	46.7
LLaVA-1.6 (7B) 2025.03		64.54	52.41	57.89	51.39	4.29	3	42.48	41.61	56.62	56.16	44.04	43.51	48.14	44.33
Qwen2-VL (7B) 2025.03		26.95	12.2	3.95	1.69	0	0	0	0	0	0	0	0	6.35	2.86
Qwen2-VL (7B) 2025.03		25.53	9.34	15.79	9.58	0	0	0	0	0	0	0	0	7.43	3.18
LLaMA-3.2 (11B) 2025.03		12.06	2.1	0	0	0	0	0	0	0	0	0	0	2.63	0.46
LLaMA-3.2 (11B) 2025.03		9.22	1.48	5.26	0.83	0	0	0	0	0	0	0	0	2.63	0.42
LLaVA-1.6 (7B) 2025.03		4.26	0.77	6.58	1.14	0	0	0	0	0	0	0	0	1.7	0.3
LLaVA-1.6 (7B) 2025.03		2.84	0.45	2.63	1.07	0	0	0	0	0	0	0	0	0.93	0.23