Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Multi-scale Mixture of World Models for Embodied Agents in Evolving Environments

About

Embodied agents operating in the real world require multi-scale reasoning and knowledge adaptation as conditions change. We identify two challenges in applying Mixture of Experts (MoE) to this setting: routing lacks an explicit notion of scale, preventing targeted updates at specific scales, and a uniform update policy cannot accommodate the different rates at which knowledge at each scale becomes outdated. We present MuSix, a framework that addresses both challenges through scale-aware world model mixture and evolution. A two-stage routing mechanism grounds scale selection in experiential distance, a measure of situational novelty inspired by Construal Level Theory: a meta-router first maps this quantity to a weight over continuous scale space, then per-scale base routers select world models within the identified scale. For adaptation, scale-dependent forgetting rates allow low-scale knowledge to refresh rapidly while high-scale abstractions persist, and gated inter-scale transfer maintains coherence across the hierarchy. Experiments on EmbodiedBench and HAZARD show that MuSix improves over state-of-the-art baselines on multi-scale reasoning and dynamic adaptation.

Jinwoo Jang, Daniel J. Rho, Sihyung Yoon, Hyunsuk Cho, Honguk Woo• 2026

Related benchmarks

TaskDatasetResultRank
Embodied NavigationEB-Navigation
Average Score57.92
21
Disaster rescueHAZARD Fire (val)
Val Score43.71
5
Embodied ReasoningEB-Habitat
Base Success Rate73.33
5
Disaster rescueHAZARD Flood (val)
Validation Score49.83
5
Robotic ManipulationFranka Research 3
Task 1 Score66.7
5
Showing 5 of 5 rows

Other info

Follow for update