Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators

About

Training-free motion customization imposes motion patterns from reference videos onto video generators through test-time computation. Most existing methods target full diffusion models, requiring many denoising steps and high computational cost. With the rise of efficient distilled models, a natural question arises: can test-time motion customization be applied directly to distilled generators with their accelerated sampling and efficiency gains? However, our analysis reveals that existing training-free techniques fail on distilled models. Distillation fundamentally alters the denoising dynamics that prior test-time guidance relies on, and the large denoising steps of distilled generators discard the dense intermediate states that score guidance requires, rendering existing motion control strategies incompatible with fast generation. To address this limitation, we propose MotionEcho, a novel training-free test-time distillation framework that enables motion customization for distilled video generators. The key idea is to correct the student model's sampling trajectory with restricted usage of a high-quality diffusion teacher at inference time. Teacher supervises the student's denoising by re-noising the student's endpoint onto its dense trajectory to form a motion-aligned clean endpoint, then interpolating it with the student's, while an adaptive scheduling mechanism determines when and how much teacher guidance is needed. As a result, MotionEcho restores generative trajectories for distilled video generators via lightweight, adaptive test-time teacher guidance, enabling accurate motion control without compromising generation efficiency. Extensive experiments on multiple distilled video generation models demonstrate that our method significantly improves motion fidelity and visual quality while retaining the efficiency advantages of distilled generation.

Jintao Rong, Xin Xie, Xinyi Yu, Linlin Ou, Xinyu Zhang, Chunhua Shen, Dong Gong• 2025

Related benchmarks

TaskDatasetResultRank
Motion CustomizationDavisBench
Temporal Consistency (TC)97.8
22
Motion CustomizationTGVE 76 videos (full)
Temporal Consistency91.8
16
Video Motion CustomizationTurboBench
TC97.6
9
Text-guided Video EditingDavisBench
TC0.97
6
Motion TransferAnimateBench
TC98.1
5
Showing 5 of 5 rows

Other info

Follow for update