Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Kernel-Gradient Drifting Models

About

We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because it enables fast, high-quality generation without distilling a large pretrained diffusion model, but its theory is currently understood mainly for Gaussian kernels, where the drift coincides with smoothed score matching and is identifiable. Our gradient-based reformulation exposes this score-based structure for general kernels: the resulting drift is the score difference between kernel-smoothed data and model distributions, yielding identifiability for characteristic kernels and a smoothed-KL descent interpretation of the drifting dynamics. Since kernel gradients are intrinsic tangent vectors, the same construction extends naturally to Riemannian manifolds and to discrete data via the Fisher-Rao geometry of the probability simplex. Across spherical geospatial data, promoter DNA and molecule generation, kernel-gradient drifting enables state-of-the-art one-step generation beyond the Euclidean setting without distillation.

Maria Esteban-Casadevall, Jorge Carrasco-Pollo, Max Welling, Jan-Willem van de Meent, Erik J. Bekkers, Floor Eijkelboom• 2026

Related benchmarks

TaskDatasetResultRank
Molecule GenerationQM9
Validity38.9
10
Promoter DNA designPromoter DNA (test)--
9
Geospatial Event ModelingVolcano Earth Dataset
MMD0.112
7
Geospatial Event ModelingEarthquake Earth Dataset
Maximum Mean Discrepancy0.037
7
Geospatial Event ModelingFire Earth Dataset
MMD2.9
7
Geospatial Event ModelingFlood Earth Dataset
MMD0.053
7
Showing 6 of 6 rows

Other info

Follow for update