Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generation

About

We present HY-Motion 1.0, a series of state-of-the-art, large-scale, motion generation models capable of generating 3D human motions from textual descriptions. HY-Motion 1.0 represents the first successful attempt to scale up Diffusion Transformer (DiT)-based flow matching models to the billion-parameter scale within the motion generation domain, delivering instruction-following capabilities that significantly outperform current open-source benchmarks. Uniquely, we introduce a comprehensive, full-stage training paradigm -- including large-scale pretraining on over 3,000 hours of motion data, high-quality fine-tuning on 400 hours of curated data, and reinforcement learning from both human feedback and reward models -- to ensure precise alignment with the text instruction and high motion quality. This framework is supported by our meticulous data processing pipeline, which performs rigorous motion cleaning and captioning. Consequently, our model achieves the most extensive coverage, spanning over 200 motion categories across 6 major classes. We release HY-Motion 1.0 to the open-source community to foster future research and accelerate the transition of 3D human motion generation models towards commercial maturity.

Yuxin Wen, Qing Shuai, Di Kang, Jing Li, Cheng Wen, Yue Qian, Ningxin Jiao, Changhai Chen, Weijie Chen, Yiran Wang, Jinkun Guo, Dongyue An, Han Liu, Yanyu Tong, Chao Zhang, Qing Guo, Juan Chen, Qiao Zhang, Youyi Zhang, Zihao Yao, Cheng Zhang, Hong Duan, Xiaoping Wu, Qi Chen, Fei Cheng, Liang Dong, Peng He, Hao Zhang, Jiaxin Lin, Chao Zhang, Zhongyi Fan, Yifan Li, Zhichao Hu, Yuhong Liu, Linus, Jie Jiang, Xiaolong Li, Linchao Bao• 2025

Related benchmarks

TaskDatasetResultRank
Motion GenerationMBench 16 (official leaderboard)
Jitter Penalty0.008
17
Text-to-motionHumanML3D 10 (test)
R-Precision@156.2
12
Text-to-motionMotionHub (test)
R-Precision (T1)41.6
12
Temporal Inpainting (Backcasting)HumanML3D
MPJPE13.6
10
Temporal Inpainting (Prediction)HumanML3D
MPJPE13.7
10
Co-speech gesture generationSuSuInterActs (test)
R@15.21
8
Geometric-Constrained Motion GenerationGeometric-Constrained Generation
Trajectory Error325.1
8
Text-to-motionHumanML3D official evaluator from MotionStreamer (test)
FID61.035
7
Text-to-motionCustom Diverse Text-to-Motion 1.0 (test)
Locomotion Score3.59
5
Text-to-motion generationText-to-motion 1.0 (test)
Locomotion Score3.76
5
Showing 10 of 12 rows

Other info

Follow for update