Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

RynnVLA-002: A Unified Vision-Language-Action and World Model

About

We introduce RynnVLA-002, a unified Vision-Language-Action (VLA) and world model. The world model leverages action and visual inputs to predict future image states, learning the underlying physics of the environment to refine action generation. Conversely, the VLA model produces subsequent actions from image observations, enhancing visual understanding and supporting the world model's image generation. The unified framework of RynnVLA-002 enables joint learning of environmental dynamics and action planning. Our experiments show that RynnVLA-002 surpasses individual VLA and world models, demonstrating their mutual enhancement. We evaluate RynnVLA-002 in both simulation and real-world robot tasks. RynnVLA-002 achieves 97.4% success rate on the LIBERO simulation benchmark without pretraining, while in real-world LeRobot experiments, its integrated world model boosts the overall success rate by 50%.

Jun Cen, Siteng Huang, Yuqian Yuan, Kehan Li, Hangjie Yuan, Chaohui Yu, Bohan Hou, Yuming Jiang, Jiayan Guo, Xin Li, Hao Luo, Fan Wang, Deli Zhao, Hao Chen• 2025

Related benchmarks

TaskDatasetResultRank
Robot ManipulationLIBERO
Object Achievement99.8
957
Robotic ManipulationLIBERO
Spatial Success Rate94.2
527
Place the block inside the circleSO100 Multi-Target
Success Rate90
4
Place the strawberries into the cupSO100 Multi-Target
Success Rate80
4
Place the block inside the circleSO100 w/ Distractors
Success Rate80
4
Place the strawberries into the cupSO100 Single-Target
Success Rate80
4
Place the strawberries into the cupSO100 w/ Distractors
Success Rate50
4
Place the block inside the circleSO100 Single-Target
Success Rate90
4
Showing 8 of 8 rows

Other info

GitHub

Follow for update