Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WSA$_1$: a 3D-Centric World-Spatial-Action Model for Generalizable Robot Control

About

Recent advances in embodied AI have established robot foundation models (RFMs) as the dominant approach for generalist robotic systems to date. By leveraging imitation learning on extensive robot demonstrations, RFMs have achieved impressive capabilities in mapping visual observations and language instructions to continuous robotic actions. However, current RFMs lack an inherent ability to reason about physical dynamics and the causal effects of robot behaviors on the 3D physical world. This creates a fundamental mismatch between 2D-centric visual perception and 3D-centric embodied interaction, severely limiting the generalization ability of RFMs in real-world tasks.To address this gap, we present WSA$_1$, a novel RFM built upon proposed 3D-Centric World-Spatial-Action modeling paradigm. It not only learns 3D world-aware visual thought for future robot behaviors, but also models mutual constraints between 3D world state transitions and robotic actions to enhance behavior generalization. Notably, WSA$_1$ achieves highly data-efficient pre-training with 6k hours of expert demonstration data (only 1k hours from real robot), while delivering competitive manipulation performance (93% success rate) on RoboTwin2.0 simulation benchmark and achieving +20% average boosted performance over state-of-the-art RFMs on real-world robot control tasks. These results reveal that generalizable RFM can be attained without large-scale real robot data when paired with 3D-centric world-action joint modeling, which offers a practical and affordable pathway to generalist robotic systems.

Jiahao Jiang, Jianing Zhang, Zhenhan Yin, Ruidong Chen, Sen Wang, Zhaoshu Yu, Pengpeng Zeng, Xiaofeng Cao, Xuanhan Wang, Jingkuan Song, Heng Tao Shen• 2026

Related benchmarks

TaskDatasetResultRank
Robot ManipulationRoboTwin Randomized 2.0--
100
Robot ManipulationLIBERO
Spatial Success Rate99.4
58
Robotic ManipulationRoboTwin Hard 2.0
Overall Success Rate93.1
21
Bimanual ManipulationRoboTwin Clean 2.0
Average Success Rate93.5
12
Trash CleaningReal-world Tabletop ARX Lift2
Success Rate87
10
Object OrganizationReal-world Tabletop AgileX Piper
Success Rate (SR)80
5
Overall Robotic ManipulationReal-world Tabletop Manipulation Tasks Average
Success Rate80.3
5
Pen Holder PlacementReal-world Tabletop ARX Lift2
Success Rate (SR)87
5
RGB Block SortingReal-world Tabletop AgileX Piper
Success Rate (SR)83
5
Toy Box OrganizationReal-world Tabletop ARX Lift2
SR70
5
Showing 10 of 11 rows

Other info

Follow for update