Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Kuramoto Orientation Diffusion Models

About

Orientation-rich images, such as fingerprints and textures, often exhibit coherent angular directional patterns that are challenging to model using standard generative approaches based on isotropic Euclidean diffusion. Motivated by the role of phase synchronization in biological systems, we propose a score-based generative model built on periodic domains by leveraging stochastic Kuramoto dynamics in the diffusion process. In neural and physical systems, Kuramoto models capture synchronization phenomena across coupled oscillators -- a behavior that we re-purpose here as an inductive bias for structured image generation. In our framework, the forward process performs \textit{synchronization} among phase variables through globally or locally coupled oscillator interactions and attraction to a global reference phase, gradually collapsing the data into a low-entropy von Mises distribution. The reverse process then performs \textit{desynchronization}, generating diverse patterns by reversing the dynamics with a learned score function. This approach enables structured destruction during forward diffusion and a hierarchical generation process that progressively refines global coherence into fine-scale details. We implement wrapped Gaussian transition kernels and periodicity-aware networks to account for the circular geometry. Our method achieves competitive results on general image benchmarks and significantly improves generation quality on orientation-dense datasets like fingerprints and textures. Ultimately, this work demonstrates the promise of biologically inspired synchronization dynamics as structured priors in generative modeling.

Yue Song, T. Anderson Keller, Sevan Brodjian, Takeru Miyato, Yisong Yue, Pietro Perona, Max Welling• 2025

Related benchmarks

TaskDatasetResultRank
Image GenerationCIFAR-10
FID10.79
203
Image Generationground terrain dataset
FID30.62
9
Image GenerationSOCOFing fingerprint dataset
FID18.75
9
Image GenerationBrodatz texture dataset (test)
FID14.19
9
Generative ModelingFIRE (test)
Test NLL-1.44
7
Generative ModelingVolcano (test)
Test NLL-5.18
7
Generative ModelingEarthquake (test)
Test NLL-0.18
7
Generative ModelingFlood (test)
Test NLL0.49
7
Texture GenerationBrodatz texture dataset
CMMD0.03
6
Unconditional GenerationNavier-Stokes
Slope Difference0.3343
4
Showing 10 of 11 rows

Other info

Follow for update