Share your thoughts, 1 month free Claude Pro on usSee more

Robot Manipulation on SimplerEnv Bridge

87.5Carrot Success Count

GTA-VLA

Updated 19d ago

Evaluation Results

Method
GTA-VLA 2026.07	87.5	81.2	75	95.8	66.7	-
ACE-Brain-0.5-VLA 2026.07	79.2	82.3	100	75	75	-
Paligemma-2 2026.01	75	-	75	79.2	0	57.3
Paligemma-2-3B 2026.03	75	-	75	79.2	0	57.3
X-VLA 2026.07	75	76	70.8	95.8	62.5	-
Uni-VLA 2026.07	66.7	69.8	95.8	83.3	33.3	-
GR00T N1 2026.07	65.5	57.1	93	64.5	5.5	-
pi0* (Paligemma-1) 2026.01	62.5	-	100	54.2	25	60.4
pi0* 2026.03	62.5	-	100	54.2	25	60.4
Qwen3VL-8B 2026.01	58.3	-	95.8	79.2	0	58.3
Qwen3VL-8B 2026.03	58.3	-	95.8	79.2	0	58.3
Qwen3VL-4B 2026.01	54.2	-	95.8	75	0	56.3
Paligemma-1 2026.01	50	-	91.7	75	4.2	55.3
Paligemma-1-3B 2026.03	50	-	91.7	75	4.2	55.3
π0 2026.07	41.7	47.9	70.8	50	29.2	-
ThinkAct (Qwen2.5VL-7B) 2026.01	37.5	-	70.8	58.3	8.7	43.8
KosMos-2 2026.01	37.5	-	100	75	29.2	60.4
ThinkAct* 2026.03	37.5	-	70.8	58.3	8.7	43.8
KosMos-2-1.7B 2026.03	37.5	-	100	75	29.2	60.4
OmniStream-7B 2026.03	33.3	-	83.3	41.7	25	45.8
Qwen3VL-30B-A3B 2026.01	29.2	-	79.2	70.8	0	44.8
Qwen2.5VL-3B 2026.01	20.8	-	91.7	79.2	0	48
Qwen3VL-2B 2026.01	20.8	-	95.8	79.2	0	49
Qwen2.5VL-7B 2026.01	12.5	-	100	75	0	46.8
Qwen2.5VL-7B 2026.03	12.5	-	100	75	0	46.8
ThinkAct 2026.07	8.7	43.8	70.8	37.5	58.3	-
OpenVLA (Llama-2) 2026.01	4.2	-	0	0	12.5	4.2
OpenVLA* 2026.03	4.2	-	0	0	12.5	4.2
Qwen2.5VL-7B 2026.03	4.2	-	66.6	4.2	0	18.5
LLaVA-Video-7B 2026.03	0	-	87.5	33.3	0	30.2
OpenVLA 2026.07	0	14.6	45.8	4.2	8.3	-
Octo 2025.02	-	15.9	-	-	-	-
RT-1-X 2025.02	-	1.1	-	-	-	-
OpenVLA 2025.02	-	14.5	-	-	-	-
Magma-8B 2025.02	-	35.4	-	-	-	-
OpenVLA (Llama-2) 2026.04	-	4.2	-	-	-	-
π0 (Paligemma-1) 2026.04	-	60.4	-	-	-	-
Qwen2.5VL-3B 2026.04	-	48	-	-	-	-
Qwen2.5VL-7B 2026.04	-	46.8	-	-	-	-
Qwen3VL-2B 2026.04	-	49	-	-	-	-
Qwen3VL-4B 2026.04	-	56.3	-	-	-	-
Qwen3VL-8B 2026.04	-	58.3	-	-	-	-
Qwen3VL-30B-A3B 2026.04	-	44.8	-	-	-	-
Paligemma-1 2026.04	-	55.3	-	-	-	-
Paligemma-2 2026.04	-	57.3	-	-	-	-
KosMos-2 2026.04	-	60.4	-	-	-	-
InternVL3.5-1B 2026.04	-	36.5	-	-	-	-
InternVL3.5-1B + EmbodiedMidtrain 2026.04	-	56.3	-	-	-	-
Qwen3VL-2B (low budget) 2026.04	-	38.5	-	-	-	-
Qwen3VL-2B + EmbodiedMidtrain 2026.04	-	45.8	-	-	-	-
Qwen-VLA-Instruct 2026.07	-	73.7	-	-	-	-