Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MoRL: Reinforced Reasoning for Unified Motion Understanding and Generation

About

Human motion understanding and generation are crucial for vision and robotics but remain limited in reasoning capability and test-time planning. We propose MoRL, a unified multimodal motion model trained with supervised fine-tuning and reinforcement learning with verifiable rewards. Our task-specific reward design combines semantic alignment and reasoning coherence for understanding with physical plausibility and text-motion consistency for generation, improving both logical reasoning and perceptual realism. To further enhance inference, we introduce Chain-of-Motion (CoM), a test-time reasoning method that enables step-by-step planning and reflection. We also construct two large-scale CoT datasets, MoUnd-CoT-140K and MoGen-CoT-140K, to align motion sequences with reasoning traces and action descriptions. Experiments on HumanML3D and KIT-ML show that MoRL achieves significant gains over state-of-the-art baselines. Code: https://github.com/AIGeeksGroup/MoRL. Website: https://aigeeksgroup.github.io/MoRL.

Hongpeng Wang, Zeyu Zhang, Wenhao Li, Hao Tang• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-motion generationHumanML3D (test)
FID0.203
331
Text-to-motion generationKIT-ML (test)
FID0.204
115
Motion DescriptionHumanML3D (test)
BLEU-156.99
27
Motion UnderstandingKIT-ML (test)
BLEU@152.11
9
Showing 4 of 4 rows

Other info

GitHub

Follow for update