Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model

About

Successful generalist Vision-Language-Action (VLA) models rely on effective training across diverse robotic platforms with large-scale, cross-embodiment, heterogeneous datasets. To facilitate and leverage the heterogeneity in rich, diverse robotic data sources, we propose a novel Soft Prompt approach with minimally added parameters, by infusing prompt learning concepts into cross-embodiment robot learning and introducing separate sets of learnable embeddings for each distinct data source. These embeddings serve as embodiment-specific prompts, which in unity empower VLA models with effective exploitation of varying cross-embodiment features. Our new X-VLA, a neat flow-matching-based VLA architecture, relies exclusively on soft-prompted standard Transformer encoders, enjoying both scalability and simplicity. Evaluated across 6 simulations as well as 3 real-world robots, our 0.9B instantiation-X-VLA-0.9B simultaneously achieves SOTA performance over a sweep of benchmarks, demonstrating superior results on a wide axes of capabilities, from flexible dexterity to quick adaptation across embodiments, environments, and tasks. Website: https://thu-air-dream.github.io/X-VLA/

Jinliang Zheng, Jianxiong Li, Zhihao Wang, Dongxiu Liu, Xirui Kang, Yuchun Feng, Yinan Zheng, Jiayin Zou, Yilun Chen, Jia Zeng, Ya-Qin Zhang, Jiangmiao Pang, Jingjing Liu, Tai Wang, Xianyuan Zhan• 2025

Related benchmarks

TaskDatasetResultRank
Robot ManipulationLIBERO
Object Achievement98.6
957
Robotic ManipulationLIBERO
Spatial Success Rate98.2
527
Robotic ManipulationLIBERO-Plus
Language Understanding Score75.7
249
Robot ManipulationLIBERO (test)
Average Success Rate98.1
220
Robotic ManipulationCalvin ABCD→D
Avg Length4.151
130
Robotic ManipulationRoboTwin 2.0
Average Success Rate72.85
100
Robotic ManipulationLIBERO 1.0 (test)
Long97.6
57
Robotic ManipulationLIBERO
Spatial Success Rate98.2
52
Robot ManipulationLIBERO-Plus Zero-shot
Camera Score23.4
42
Robot ManipulationRoboTwin Clean 2.0
Average Success Rate73
39
Showing 10 of 82 rows
...

Other info

Follow for update