Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Probability Density Geodesics in Image Diffusion Latent Space

About

Diffusion models indirectly estimate the probability density over a data space, which can be used to study its structure. In this work, we show that geodesics can be computed in diffusion latent space, where the norm induced by the spatially-varying inner product is inversely proportional to the probability density. In this formulation, a path that traverses a high density (that is, probable) region of image latent space is shorter than the equivalent path through a low density region. We present algorithms for solving the associated initial and boundary value problems and show how to compute the probability density along the path and the geodesic distance between two points. Using these techniques, we analyze how closely video clips approximate geodesics in a pre-trained image diffusion space. Finally, we demonstrate how these techniques can be applied to training-free image sequence interpolation and extrapolation, given a pre-trained image diffusion model.

Qingtao Yu, Jaskirat Singh, Zhaoyuan Yang, Peter Henry Tu, Jing Zhang, Hongdong Li, Richard Hartley, Dylan Campbell• 2025

Related benchmarks

TaskDatasetResultRank
Video Frame InterpolationDAVIS--
33
Image interpolationMorphBench (A)
PPL0.389
14
Image interpolationMorphBench (M)
PPL1.016
14
Image interpolationCelebA-HQ (CA)
PPL0.659
14
Image interpolationAF
Perplexity (PPL)0.816
14
Video Frame InterpolationHuman
MSE3.363
14
Video Frame InterpolationRE10K
MSE4.753
14
Image BlendingTotally Looks Like High Difficulty
AMD Score (Input 1)0.554
8
Image BlendingTotally Looks Like Low Difficulty
Attribute-Masked DreamSim (Input 1)0.571
8
Path InterpolationSynthetic C-shaped 2D distribution
Standard Deviation0.1073
4
Showing 10 of 10 rows

Other info

Follow for update