Scaling by Diversified Experience for Vision-Language-Action Models
About
Vision-Language-Action models face significant challenges in real-world deployment due to the entanglement of high-level reasoning with low-level control, and the instability of policy optimization. In this paper, we introduce SyVLA, a robust VLA model trained with diversified experiences. We propose an Intention Decoupling algorithm to isolate control-relevant features from reasoning contexts and a similar-sample guided RL pipeline to stabilize policy updates and mitigate distribution shift. Extensive experiments on real-world robotic tasks and multi-modal benchmarks demonstrate that SyVLA achieves superior task success rates and stronger out-of-distribution generalization compared to existing methods, while effectively preserving core vision-language capabilities. Codes and Datasets is released on \href{https://sy-vla.github.io/}{project page}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Diagram Question Answering | AI2D | AI2D Accuracy67.7 | 509 | |
| Multi-discipline Multimodal Understanding | MMMU | Accuracy35.78 | 422 | |
| Multimodal Model Evaluation | MME | MME Score1.80e+3 | 80 | |
| Document Visual Question Answering | DocVQA | ANLS80.01 | 49 | |
| Object Hallucination Evaluation | HallBench | Accuracy42.53 | 12 | |
| Robotic Manipulation | Real-world robotic tasks In Domain | Task 1 Success Rate86 | 7 | |
| Robotic Manipulation | Real-world robotic tasks Out of Distribution | Task 1 Success Rate78 | 7 |