Multi-scale Mixture of World Models for Embodied Agents in Evolving Environments
About
Embodied agents operating in the real world require multi-scale reasoning and knowledge adaptation as conditions change. We identify two challenges in applying Mixture of Experts (MoE) to this setting: routing lacks an explicit notion of scale, preventing targeted updates at specific scales, and a uniform update policy cannot accommodate the different rates at which knowledge at each scale becomes outdated. We present MuSix, a framework that addresses both challenges through scale-aware world model mixture and evolution. A two-stage routing mechanism grounds scale selection in experiential distance, a measure of situational novelty inspired by Construal Level Theory: a meta-router first maps this quantity to a weight over continuous scale space, then per-scale base routers select world models within the identified scale. For adaptation, scale-dependent forgetting rates allow low-scale knowledge to refresh rapidly while high-scale abstractions persist, and gated inter-scale transfer maintains coherence across the hierarchy. Experiments on EmbodiedBench and HAZARD show that MuSix improves over state-of-the-art baselines on multi-scale reasoning and dynamic adaptation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Embodied Navigation | EB-Navigation | Average Score57.92 | 21 | |
| Disaster rescue | HAZARD Fire (val) | Val Score43.71 | 5 | |
| Embodied Reasoning | EB-Habitat | Base Success Rate73.33 | 5 | |
| Disaster rescue | HAZARD Flood (val) | Validation Score49.83 | 5 | |
| Robotic Manipulation | Franka Research 3 | Task 1 Score66.7 | 5 |