HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation
About
We present HY-Motion 1.0, a series of state-of-the-art, large-scale, motion generation models capable of generating 3D human motions from textual descriptions. HY-Motion 1.0 represents the first successful attempt to scale up Diffusion Transformer (DiT)-based flow matching models to the billion-parameter scale within the motion generation domain, delivering instruction-following capabilities that significantly outperform current open-source benchmarks. Uniquely, we introduce a comprehensive, full-stage training paradigm -- including large-scale pretraining on over 3,000 hours of motion data, high-quality fine-tuning on 400 hours of curated data, and reinforcement learning from both human feedback and reward models -- to ensure precise alignment with the text instruction and high motion quality. This framework is supported by our meticulous data processing pipeline, which performs rigorous motion cleaning and captioning. Consequently, our model achieves the most extensive coverage, spanning over 200 motion categories across 6 major classes. We release HY-Motion 1.0 to the open-source community to foster future research and accelerate the transition of 3D human motion generation models towards commercial maturity.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Motion Generation | MBench 16 (official leaderboard) | Jitter Penalty0.008 | 17 | |
| Text-to-motion | HumanML3D 10 (test) | R-Precision@156.2 | 12 | |
| Text-to-motion | MotionHub (test) | R-Precision (T1)41.6 | 12 | |
| Temporal Inpainting (Backcasting) | HumanML3D | MPJPE13.6 | 10 | |
| Temporal Inpainting (Prediction) | HumanML3D | MPJPE13.7 | 10 | |
| Co-speech gesture generation | SuSuInterActs (test) | R@15.21 | 8 | |
| Geometric-Constrained Motion Generation | Geometric-Constrained Generation | Trajectory Error325.1 | 8 | |
| Text-to-motion | HumanML3D official evaluator from MotionStreamer (test) | FID61.035 | 7 | |
| Text-to-motion | Custom Diverse Text-to-Motion 1.0 (test) | Locomotion Score3.59 | 5 | |
| Text-to-motion generation | Text-to-motion 1.0 (test) | Locomotion Score3.76 | 5 |