Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LaST$_{0}$: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model

About

Vision-Language-Action (VLA) models have recently shown strong generalization, with some approaches seeking to explicitly generate linguistic reasoning traces or predict future observations prior to execution. However, explicit reasoning typically incurs non-negligible inference latency, which constrains the temporal resolution required for robotic manipulation. Moreover, such reasoning is confined to the linguistic space, imposing a representational bottleneck that struggles to faithfully capture ineffable physical attributes. To mitigate these limitations, we propose LaST$_0$, a framework that enables efficient reasoning before acting through a Latent Spatio-Temporal Chain-of-Thought (CoT), capturing fine-grained physical and robotic dynamics that are often difficult to verbalize. Specifically, we introduce a token-efficient latent CoT space that models future visual dynamics, 3D structural information, and robot proprioceptive states, and further extends these representations across time to enable temporally consistent implicit reasoning trajectories. Furthermore, LaST$_0$ adopts a dual-system architecture implemented via a Mixture-of-Transformers design, where a reasoning expert conducts low-frequency latent inference and an acting expert generates high-frequency actions conditioned on robotics-oriented latent representations. To facilitate coordination, LaST$_0$ is trained with heterogeneous operation frequencies, enabling adaptive switching during deployment. Across 10 real-world tasks spanning tabletop, mobile, and dexterous hand manipulation, LaST$_0$ improves mean success rates by 13%, 14% and 14% over prior SOTA VLA methods, respectively.

Zhuoyang Liu, Jiaming Liu, Hao Chen, Jiale Yu, Ziyu Guo, Chengkai Hou, Chenyang Gu, Xiangju Mi, Renrui Zhang, Kun Wu, Zhengping Che, Jian Tang, Pheng-Ann Heng, Shanghang Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Robotic ManipulationReal-robot manipulation tasks Aggregate
Average Success Rate (Avg SR)63
19
Multi-task Robot ManipulationRLBench
Close box95
7
Robotic ManipulationUnseen Position
Unscrew Cap Success Rate30
6
Robotic ManipulationUnseen Background
Unscrew Cap Success Rate65
6
Robotic ManipulationUnSeen-Object
Unscrew Cap Success Rate65
6
Grasp with a ClampTianji Marvin + WUJI In-domain
Success Rate50
5
Organize BoxGalaxea R1 Lite In-domain
Success Rate70
5
Pour WaterTianji Marvin + WUJI In-domain
Success Rate40
5
Unscrew bottle capGalaxea In-domain R1 Lite
Success Rate80
5
Put Items to Bag and ZipTianji Marvin In-domain
Success Rate60
5
Showing 10 of 15 rows

Other info

Follow for update