Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ReAlign: Text-to-Motion Generation via Step-Aware Reward-Guided Alignment

About

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and realistic motion. However, there exists a misalignment between text and motion distributions in diffusion models, which leads to semantically inconsistent or low-quality motions. To address this limitation, we propose Reward-guided sampling Alignment (ReAlign), comprising a step-aware reward model to assess alignment quality during the denoising sampling and a reward-guided strategy that directs the diffusion process toward an optimally aligned distribution. This reward model integrates step-aware tokens and combines a text-aligned module for semantic consistency and a motion-aligned module for realism, refining noisy motions at each timestep to balance probability density and alignment. Extensive experiments of both motion generation and retrieval tasks demonstrate that our approach significantly improves text-motion alignment and motion quality compared to existing state-of-the-art methods.

Wanjiang Weng, Xiaofeng Tan, Junbo Wang, Guo-Sen Xie, Pan Zhou, Hongsong Wang• 2025

Related benchmarks

TaskDatasetResultRank
Human-Object Interaction Controllable Motion GenerationHOI-1 Open-set constraint specifications
Skating Score19.3
9
Geometric-constraint Controllable Motion GenerationOpen-set constraint specifications GEO-1
Skating Accuracy12.2
9
Controllable Motion Generation (HSI-1)HumanML3D (test)
Skating Rate9.6
8
Human-Scene Interaction Controllable Motion GenerationHSI-2 Open-set
Skating Accuracy24.5
7
Human-Scene Interaction Controllable Motion GenerationOpen-set constraint specifications HSI-3
Skating0.133
7
Showing 5 of 5 rows

Other info

Follow for update