Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model

About

Vision-Language-Action (VLA) models typically bridge the gap between perceptual and action spaces by pre-training a large-scale Vision-Language Model (VLM) on robotic data. While this approach greatly enhances performance, it also incurs significant training costs. In this paper, we investigate how to effectively bridge vision-language (VL) representations to action (A). We introduce VLA-Adapter, a novel paradigm designed to reduce the reliance of VLA models on large-scale VLMs and extensive pre-training. To this end, we first systematically analyze the effectiveness of various VL conditions and present key findings on which conditions are essential for bridging perception and action spaces. Based on these insights, we propose a lightweight Policy module with Bridge Attention, which autonomously injects the optimal condition into the action space. In this way, our method achieves high performance using only a 0.5B-parameter backbone, without any robotic data pre-training. Extensive experiments on both simulated and real-world robotic benchmarks demonstrate that VLA-Adapter not only achieves state-of-the-art level performance, but also offers the fast inference speed reported to date. Furthermore, thanks to the proposed advanced bridging paradigm, VLA-Adapter enables the training of a powerful VLA model in just 8 hours on a single consumer-grade GPU, greatly lowering the barrier to deploying the VLA model. Project page: https://vla-adapter.github.io/.

Yihao Wang, Pengxiang Ding, Lingxiao Li, Can Cui, Zirui Ge, Xinyang Tong, Wenxuan Song, Han Zhao, Wei Zhao, Pengxu Hou, Siteng Huang, Yifan Tang, Wenhui Wang, Ru Zhang, Jianyi Liu, Donglin Wang• 2025

Related benchmarks

TaskDatasetResultRank
Robot ManipulationLIBERO
Goal Achievement98.2
700
Robotic ManipulationLIBERO
Spatial Success Rate99.6
314
Robot ManipulationLIBERO (test)
Average Success Rate97.3
184
Robotic ManipulationLIBERO-Plus
Average Score59
107
Sequential Robotic ManipulationCALVIN
Success Rate (1 task)99.1
45
Robot ManipulationLIBERO
Spatial Success Rate92.2
30
Robotic ManipulationMeta-World
Success Rate (Easy)3.75
16
Dynamic ManipulationDomino
Success Rate (SR)4.4
12
Dynamic Object ManipulationDOM Simulation 1.0 (test)
Reactivity (CR)2.10e+3
9
Language-conditioned long-horizon robotic manipulationCalvin ABC->D
Success Rate (1 Task)99.1
8
Showing 10 of 13 rows

Other info

Follow for update