Semi-Supervised Vision-Language-Action Model
About
Vision-Language-Action (VLA) models enable robots to predict actions directly from visual observations and language instructions, but adapting them to new environments still depends on costly action-labeled demonstrations. To reduce this dependence, we study semi-supervised VLA adaptation under limited supervision signals, where only a small portion of trajectories contain robot actions and the remaining trajectories provide action-unlabeled vision-language observations. Unlike standard semi-supervised learning, the missing supervision is an embodied action signal that must be visually grounded, language-consistent, physically feasible, and temporally stable. To address this problem, we propose SemiVLA, a self-distilled teacher-student framework that learns from reliable pseudo-actions on unlabeled trajectories. SemiVLA introduces a VLA-specific reliability controller to assess vision-language alignment, action feasibility, and temporal transition consistency, and further updates the teacher through a Bottleneck-Projected Alignment Update to avoid noisy feedback contamination. With OpenVLA as the backbone, SemiVLA consistently improves multiple PEFT strategies across LIBERO and CALVIN. Under 10\% labeled trajectories, SemiVLA with Selective LoRA achieves 89.0\% average success on LIBERO, outperforming supervised LoRA by 8.0 points without extra inference cost.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robot Manipulation | SimplerEnv | Pick-Can Success Rate92 | 32 | |
| Vision-Language-Action | LIBERO | Success Rate (Spatial)92.4 | 28 | |
| Robot Task Completion | LIBERO | Success Rate (Mean)94.1 | 27 | |
| Robot Manipulation | LIBERO Spatial Object Goal Long | Spatial Success Score92.4 | 26 | |
| Robotic Manipulation | CALVIN | -- | 13 | |
| Robot Manipulation | LIBERO unseen tasks perturbed environments | Success Rate (Unseen Task)75.6 | 7 |