Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Scaling Tasks, Not Samples: Mastering Humanoid Control through Multi-Task Model-Based Reinforcement Learning

About

Developing generalist robots capable of mastering diverse skills remains a central challenge in embodied AI. While recent progress emphasizes scaling model parameters and offline datasets, such approaches are limited in robotics, where learning requires active interaction. We argue that effective online learning should scale the \emph{number of tasks}, rather than the number of samples per task. This regime reveals a structural advantage of model-based reinforcement learning (MBRL). Because physical dynamics are invariant across tasks, a shared world model can aggregate multi-task experience to learn robust, task-agnostic representations. In contrast, model-free methods suffer from gradient interference when tasks demand conflicting actions in similar states. Task diversity therefore acts as a regularizer for MBRL, improving dynamics learning and sample efficiency. We instantiate this idea with \textbf{EfficientZero-Multitask (EZ-M)}, a sample-efficient multi-task MBRL algorithm for online learning. Evaluated on \textbf{HumanoidBench}, a challenging whole-body control benchmark, EZ-M achieves state-of-the-art performance with significantly higher sample efficiency than strong baselines, without extreme parameter scaling. These results establish task scaling as a critical axis for scalable robotic learning. The project website is available \href{https://yewr.github.io/ez_m/}{here}.

Shaohuai Liu, Weirui Ye, Yilun Du, Le Xie• 2026

Related benchmarks

TaskDatasetResultRank
h1hand-hurdleHumanoidBench Hard 1M
Score405.7
5
h1hand-mazeHumanoidBench Hard 1M
Score380.6
5
h1hand-poleHumanoidBench Hard 1M
Score841.4
5
h1hand-reachHumanoidBench Hard 1M
Score5.35e+3
5
h1hand-runHumanoidBench Hard 1M
Score818.4
5
h1hand-slideHumanoidBench Hard 1M
Score535.4
5
h1hand-stairHumanoidBench Hard 1M
Score380.3
5
h1hand-standHumanoidBench Hard 1M
Score891.8
5
h1hand-walkHumanoidBench Hard 1M
Score920
5
h1hand-balance simpleHumanoidBench Hard 1M
Score98.004
5
Showing 10 of 15 rows

Other info

Follow for update