Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment

About

Vision-language-action models (VLAs) have recently advanced robotic manipulation, yet the effects of different robot-data pre-training paradigms remain difficult to compare because existing models often differ in architecture, data, action space, and evaluation protocol. We present VLAFlow (Vision-Language-Action Flow), a unified flow-matching framework for controlled comparison of VLA training objectives. Using a heterogeneous robot corpus, OXEMix, containing approximately 5,000 hours of data from DROID, OpenX-Embodiment, OpenX-Augmented, and RoboCOIN, we evaluate four paradigms under the same pi0-style architecture, shared VLM backbone, action expert, and 14-dimensional action space: action-only modeling (MindPI), language-supervised co-training (MindLPI), future latent alignment (MindWPI), and their combination (MindLWPI). Experiments on LIBERO, LIBERO-Plus, and SimplerEnv show that action-only pre-training is sensitive to heterogeneous data. In contrast, language supervision helps preserve vision-language generalization, while future latent alignment improves state-transition and action-outcome modeling. By combining both signals, MindLWPI achieves the most stable overall transfer performance across benchmarks. These results suggest a meta-action space view: language and future latent representations provide complementary intermediate constraints that make heterogeneous action supervision smoother and more transferable.

Guoyang Xia, Fengfa Li, Hongjin Ji, Lei Ren, Fangxiang Feng, Kun Zhan, Yan Xie• 2026

Related benchmarks

TaskDatasetResultRank
Robot ManipulationSimplerEnv WidowX
Overall Success Rate75.5
123
Robot ManipulationLIBERO-Plus Zero-shot
Camera Score46.2
59
Robot ManipulationLIBERO
Spatial Success Rate99.2
58
Robot ManipulationSimplerEnv RT-1 Visual Matching
Success Rate86.7
14
Robot ManipulationSimplerEnv RT-1 Visual Augmentation
Success Rate71.1
14
Showing 5 of 5 rows

Other info

Follow for update