X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model
About
Successful generalist Vision-Language-Action (VLA) models rely on effective training across diverse robotic platforms with large-scale, cross-embodiment, heterogeneous datasets. To facilitate and leverage the heterogeneity in rich, diverse robotic data sources, we propose a novel Soft Prompt approach with minimally added parameters, by infusing prompt learning concepts into cross-embodiment robot learning and introducing separate sets of learnable embeddings for each distinct data source. These embeddings serve as embodiment-specific prompts, which in unity empower VLA models with effective exploitation of varying cross-embodiment features. Our new X-VLA, a neat flow-matching-based VLA architecture, relies exclusively on soft-prompted standard Transformer encoders, enjoying both scalability and simplicity. Evaluated across 6 simulations as well as 3 real-world robots, our 0.9B instantiation-X-VLA-0.9B simultaneously achieves SOTA performance over a sweep of benchmarks, demonstrating superior results on a wide axes of capabilities, from flexible dexterity to quick adaptation across embodiments, environments, and tasks. Website: https://thu-air-dream.github.io/X-VLA/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robot Manipulation | LIBERO | Object Achievement98.6 | 1025 | |
| Robotic Manipulation | LIBERO | Spatial Success Rate98.2 | 570 | |
| Robotic Manipulation | LIBERO-Plus | Language Understanding Score75.7 | 414 | |
| Robot Manipulation | LIBERO (test) | Average Success Rate98.1 | 237 | |
| Robot Manipulation | LIBERO | Spatial Success Rate98.2 | 223 | |
| Robotic Manipulation | LIBERO | Long-horizon Success Rate97.6 | 165 | |
| Robotic Manipulation | Calvin ABCD→D | Avg Length4.151 | 139 | |
| Robotic Manipulation | LIBERO v1 (test) | Average Success Rate98.1 | 118 | |
| Robotic Manipulation | RoboTwin 2.0 | Average Success Rate72.85 | 115 | |
| Robotic Manipulation | LIBERO | Long Success Rate97.6 | 108 |