Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Dreaming when Necessary: Advancing World Action Models with Adaptive Multi-Modal Reasoning

About

World Action Models (WAMs) offer a promising approach to embodied intelligence, yet existing methods rely heavily on video prediction as action priors and lack adaptive multimodal reasoning, limiting their effectiveness on long-horizon, complex tasks. We observe that WAMs require different multimodal reasoning modes under different execution contexts: textual reasoning is essential during task transitions to guide high-level action prediction, while visual reasoning is critical during fine-grained manipulation for precise control. Motivated by this observation, we propose \textbf{AdaWAM}, a world action model with adaptive multimodal reasoning abilities. AdaWAM integrates a lightweight dynamic router that autonomously triggers textual or visual reasoning as needed during task execution. Experiments on both simulated and real-world embodied tasks show that AdaWAM substantially improves inference efficiency while outperforming state-of-the-art embodied policies. Codes and demos are available at: https://adawam.github.io/.

Yinzhou Tang, Jingbo Xu, Yu Shang, Zihao Song, Chen Gao, Wei Wu, Yong Li• 2026

Related benchmarks

TaskDatasetResultRank
Robotic ManipulationLIBERO
Long Success Rate99.1
108
Robot ManipulationRoboTwin Randomized 2.0
Overall Success Rate91.35
100
Robot ManipulationRoboTwin Clean 2.0--
74
Clean tableReal-world
Success Rate70
21
Showing 4 of 4 rows

Other info

Follow for update