Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Semi-Supervised Vision-Language-Action Model

About

Vision-Language-Action (VLA) models enable robots to predict actions directly from visual observations and language instructions, but adapting them to new environments still depends on costly action-labeled demonstrations. To reduce this dependence, we study semi-supervised VLA adaptation under limited supervision signals, where only a small portion of trajectories contain robot actions and the remaining trajectories provide action-unlabeled vision-language observations. Unlike standard semi-supervised learning, the missing supervision is an embodied action signal that must be visually grounded, language-consistent, physically feasible, and temporally stable. To address this problem, we propose SemiVLA, a self-distilled teacher-student framework that learns from reliable pseudo-actions on unlabeled trajectories. SemiVLA introduces a VLA-specific reliability controller to assess vision-language alignment, action feasibility, and temporal transition consistency, and further updates the teacher through a Bottleneck-Projected Alignment Update to avoid noisy feedback contamination. With OpenVLA as the backbone, SemiVLA consistently improves multiple PEFT strategies across LIBERO and CALVIN. Under 10\% labeled trajectories, SemiVLA with Selective LoRA achieves 89.0\% average success on LIBERO, outperforming supervised LoRA by 8.0 points without extra inference cost.

Hongyang He, Jiuming Liu, Victor Sanchez• 2026

Related benchmarks

TaskDatasetResultRank
Robot ManipulationSimplerEnv
Pick-Can Success Rate92
32
Vision-Language-ActionLIBERO
Success Rate (Spatial)92.4
28
Robot Task CompletionLIBERO
Success Rate (Mean)94.1
27
Robot ManipulationLIBERO Spatial Object Goal Long
Spatial Success Score92.4
26
Robotic ManipulationCALVIN--
13
Robot ManipulationLIBERO unseen tasks perturbed environments
Success Rate (Unseen Task)75.6
7
Showing 6 of 6 rows

Other info

Follow for update