Our new X account is live! Follow @wizwand_team for updates

Embodied Task Planning on VoTa-Bench (Seen)

84.72SR (Examine&Light)

D2PO

Updated 4d ago

Evaluation Results

Method	Links
D2PO 2025.03		84.72	66.67	84.52	71.27	12.5	10.23	48.21	48.21	66.36	66.36	44.44	44.33	58.11	53.33
DPO 2025.03		76.39	59.31	78.57	62.61	12.5	9.97	29.46	25.47	43.93	43.35	36.51	34.24	46.08	39.73
D2PO 2025.03		76.39	59.63	88.1	71.32	14.58	12.19	38.39	32.97	48.6	48.26	39.68	38.8	51.18	44.84
DPO 2025.03		72.22	56.67	80.95	66.3	10.42	8.47	44.64	44.64	60.75	60.75	44.44	44.04	53.92	49.37
SFT 2025.03		70.83	55.24	69.05	57.74	6.25	5.38	26.79	26.04	58.88	58.34	31.75	31.11	44.63	40.33
D2PO 2025.03		69.44	52.6	78.57	65.48	22.92	19.6	47.32	47.32	60.75	60.41	44.44	44.33	54.83	50.23
DPO 2025.03		66.67	45.77	72.62	59.17	20.83	18.2	44.64	44.64	44.86	44.86	43.65	43.07	49.54	44.38
SFT 2025.03		58.33	44.13	72.62	47.04	8.33	6.69	30.36	26.03	46.73	46.73	35.71	31.98	42.99	35.33
SFT 2025.03		56.94	45.37	63.1	51.65	12.5	9.81	31.25	31.18	50.47	50.08	30.16	29.34	41.35	37.56
GPT-4o 2025.03		41.67	30.6	64.29	45.95	4.17	1.31	1.79	1.79	24.3	23.81	11.9	11.39	23.5	18.78
Gemini-1.5-pro 2025.03		34.72	29.38	27.38	12.07	0	0	0	0	7.48	7.37	3.17	1.72	10.93	6.81
Qwen2-VL 2025.03		34.72	21.62	39.29	21.81	0	0	0	0	3.97	3.47	0.79	0.56	11.66	7.1
GPT-4o 2025.03		33.33	23.37	51.19	36.27	0	0	0	0	8.41	6.55	2.38	2.02	14.39	10.37
Qwen2-VL 2025.03		26.39	8.55	14.29	8.22	2.08	0.6	0	0	0	0	0	0	5.83	2.46
Qwen2-VL 2025.03		25	9.25	21.43	12.29	0	0	0	0	0	0	0	0	6.56	3.14
GPT-4o-mini 2025.03		22.22	10.88	14.29	8.16	0	0	0	0	0	0	0	0	5.1	2.68
LLaVA-1.6 2025.03		12.5	2.09	7.14	2.67	0	0	0	0	0	0	0	0	2.73	0.68
LLaMA-3.2-Vision 2025.03		12.5	2	4.76	0.86	0	0	0	0	0	0	0	0	2.37	0.39
LLaMA-3.2-Vision 2025.03		8.33	1.33	3.57	0.57	0	0	0	0	0	0	0	0	1.64	0.26
LLaVA-1.6 2025.03		1.39	0.22	4.76	0.76	0	0	0	0	0	0	0	0	0.91	0.15
LLaVA-1.6 2025.03		1.17	0.67	7.14	1.14	0	0	0	0	0	0	0	0	1.64	0.26