X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model
About
Successful generalist Vision-Language-Action (VLA) models rely on effective training across diverse robotic platforms with large-scale, cross-embodiment, heterogeneous datasets. To facilitate and leverage the heterogeneity in rich, diverse robotic data sources, we propose a novel Soft Prompt approach with minimally added parameters, by infusing prompt learning concepts into cross-embodiment robot learning and introducing separate sets of learnable embeddings for each distinct data source. These embeddings serve as embodiment-specific prompts, which in unity empower VLA models with effective exploitation of varying cross-embodiment features. Our new X-VLA, a neat flow-matching-based VLA architecture, relies exclusively on soft-prompted standard Transformer encoders, enjoying both scalability and simplicity. Evaluated across 6 simulations as well as 3 real-world robots, our 0.9B instantiation-X-VLA-0.9B simultaneously achieves SOTA performance over a sweep of benchmarks, demonstrating superior results on a wide axes of capabilities, from flexible dexterity to quick adaptation across embodiments, environments, and tasks. Website: https://thu-air-dream.github.io/X-VLA/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Robot Manipulation | LIBERO | Object Achievement98.6 | 957 | |
| Robotic Manipulation | LIBERO | Spatial Success Rate98.2 | 527 | |
| Robotic Manipulation | LIBERO-Plus | Language Understanding Score75.7 | 249 | |
| Robot Manipulation | LIBERO (test) | Average Success Rate98.1 | 220 | |
| Robotic Manipulation | Calvin ABCD→D | Avg Length4.151 | 130 | |
| Robotic Manipulation | RoboTwin 2.0 | Average Success Rate72.85 | 100 | |
| Robotic Manipulation | LIBERO 1.0 (test) | Long97.6 | 57 | |
| Robotic Manipulation | LIBERO | Spatial Success Rate98.2 | 52 | |
| Robot Manipulation | LIBERO-Plus Zero-shot | Camera Score23.4 | 42 | |
| Robot Manipulation | RoboTwin Clean 2.0 | Average Success Rate73 | 39 |