Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

A Time-Reparameterized Cumulative Intensity Extrapolation Sampler for Discrete Flow Matching

About

Discrete flow matching (DFM) provides a principled framework for generative modeling on discrete state spaces via continuous-time Markov chain dynamics. In practice, sampling for DFM commonly employs discretizations such as $\tau$-leaping, yet efficient sampling methods under a limited number of function evaluations (NFE) remain less studied. To address this gap, we propose the Time-Reparameterized Cumulative Intensity Extrapolation (TR-CIE) sampler, which aims to improve sampling quality when function evaluations are restricted. TR-CIE consists of two components. First, a schedule-based time reparameterization rescales the time grid according to the noise schedule. Under standard factorized DFM rate parameterizations, this transformation of variables absorbs the schedule-dependent growth term and mitigates stiffness near the terminal sampling stage. Second, we introduce a cumulative-intensity extrapolation updating rule. By reusing cached model outputs from the previous step as a history term, this improves the approximation of stepwise cumulative intensities on the resulting non-uniform time grid. We provide a theoretical analysis that bounds the local approximation error of cumulative intensities and establishes convergence results. The resulting sampler requires one NFE per step and introduces no additional model evaluations compared to the standard $\tau$-leaping sampler. Extensive experiments on synthetic tasks, text generation, and text-to-image benchmarks demonstrate that our method improves sampling quality under limited NFE.

Feiyang Fu, Hehe Fan• 2026

Related benchmarks

TaskDatasetResultRank
Text GenerationDFM 1024 samples masked backbone
GPT-2 Perplexity135.9
42
Text GenerationMasked DFM backbone 1024 samples
Unigram Entropy7.92
35
Text Generationuniform DFM backbone 1024 samples
LLaMA-3 Perplexity95.56
30
Text Generation1024 samples
Perplexity (GPT-2)104.4
30
Text-to-Image GenerationGenEval 553 prompts, 4 samples each (full)
Accuracy69.59
20
Text-to-Image GenerationGenEval 553 prompts
CLIP Score33.6
20
Showing 6 of 6 rows

Other info

Follow for update