Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Motion Inbetweening via Deep $\Delta$-Interpolator

About

We show that the task of synthesizing human motion conditioned on a set of key frames can be solved more accurately and effectively if a deep learning based interpolator operates in the delta mode using the spherical linear interpolator as a baseline. We empirically demonstrate the strength of our approach on publicly available datasets achieving state-of-the-art performance. We further generalize these results by showing that the $\Delta$-regime is viable with respect to the reference of the last known frame (also known as the zero-velocity model). This supports the more general conclusion that operating in the reference frame local to input frames is more accurate and robust than in the global (world) reference frame advocated in previous work. Our code is publicly available at https://github.com/boreshkinai/delta-interpolator.

Boris N. Oreshkin, Antonios Valkanas, F\'elix G. Harvey, Louis-Simon M\'enard, Florent Bocquelet, Mark J. Coates• 2022

Related benchmarks

TaskDatasetResultRank
Motion In-betweeningLaFAN1 (test)
L2Q0.11
77
Motion In-fillingAnidance (test)
L2P0.6
27
Motion In-betweening350k dataset
FPS1.88e+4
13
Motion GenerationHumanML3D
MMD0.1133
7
Motion GenerationLaFAN1 G1
MMD0.306
7
Motion GenerationBones-70k
MMD0.1183
7
Showing 6 of 6 rows

Other info

Code

Follow for update