Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Categorical Flow Maps

About

We introduce Categorical Flow Maps, a flow-matching method for accelerated few-step generation of categorical data via self-distillation. Building on recent variational formulations of flow matching and the broader trend towards accelerated inference in diffusion and flow-based models, we define a flow map towards the simplex that transports probability mass toward a predicted endpoint, yielding a parametrisation that naturally constrains model predictions. Since our trajectories are continuous rather than discrete, Categorical Flow Maps can be trained with existing distillation techniques, as well as a new objective based on endpoint consistency. This continuous formulation also automatically unlocks test-time inference: we can directly reuse existing guidance and reweighting techniques in the categorical setting to steer sampling toward downstream objectives. Empirically, we achieve state-of-the-art few-step results on images, molecular graphs, and text, with strong performance even in single-step generation.

Daan Roos, Oscar Davis, Floor Eijkelboom, Michael Bronstein, Max Welling, \.Ismail \.Ilkan Ceylan, Luca Ambrogioni, Jan-Willem van de Meent• 2026

Related benchmarks

TaskDatasetResultRank
Text GenerationLM1B (test)
Entropy3.1
85
Text GenerationOWT
GPT2 Perplexity76.4
41
Molecular GenerationQM9
Validity97
26
Unconditional Image GenerationMNIST Binary
FID7.8
25
Text GenerationLM1B
Perplexity (PPL)267.4
24
Molecular GenerationZINC
Validity93.5
14
Showing 6 of 6 rows

Other info

Follow for update