Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Training-Free Refinement of Flow Matching with Divergence-based Sampling

About

Flow-based models learn a target distribution by modeling a marginal velocity field, defined as the average of sample-wise velocities connecting each sample from a simple prior to the target data. When sample-wise velocities conflict at the same intermediate state, however, this averaged velocity can misguide samples toward low-density regions, degrading generation quality. To address this issue, we propose the Flow Divergence Sampler (FDS), a training-free framework that refines intermediate states before each solver step. Our key finding reveals that the severity of this misguidance is quantified by the divergence of the marginal velocity field that is readily computable during inference with a well-optimized model. FDS exploits this signal to steer states toward less ambiguous regions. As a plug-and-play framework compatible with standard solvers and off-the-shelf flow backbones, FDS consistently improves fidelity across various generation tasks including text-to-image synthesis, and inverse problems.

Yeonwoo Cha, Jaehoon Yoo, Semin Kim, Yunseo Park, Jinhyeon Kwon, Seunghoon Hong• 2026

Related benchmarks

TaskDatasetResultRank
Image GenerationCIFAR-10 (test)
FID2.44
483
Image GenerationImageNet 256x256
IS255.7
359
Unconditional Image GenerationCIFAR-10
FID1.954
240
Unconditional Image GenerationCIFAR-10 unconditional
FID1.953
165
Conditional Image GenerationCIFAR-10
FID1.785
77
Image GenerationImageNet 256 x 256
FID2.496
12
Image GenerationCIFAR-10 Conditional
FID1.786
6
Text-to-Image SynthesisDrawBench
Image Rating (IR)89.33
4
Gaussian DeblurringCat dataset
FID63.17
2
Super-ResolutionCat dataset
FID63.14
2
Showing 10 of 10 rows

Other info

Follow for update