Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FlowDPS: Flow-Driven Posterior Sampling for Inverse Problems

About

Flow matching is a recent state-of-the-art framework for generative modeling based on ordinary differential equations (ODEs). While closely related to diffusion models, it provides a more general perspective on generative modeling. Although inverse problem solving has been extensively explored using diffusion models, it has not been rigorously examined within the broader context of flow models. Therefore, here we extend the diffusion inverse solvers (DIS) - which perform posterior sampling by combining a denoising diffusion prior with an likelihood gradient - into the flow framework. Specifically, by driving the flow-version of Tweedie's formula, we decompose the flow ODE into two components: one for clean image estimation and the other for noise estimation. By integrating the likelihood gradient and stochastic noise into each component, respectively, we demonstrate that posterior sampling for inverse problem solving can be effectively achieved using flows. Our proposed solver, Flow-Driven Posterior Sampling (FlowDPS), can also be seamlessly integrated into a latent flow model with a transformer architecture. Across four linear inverse problems, we confirm that FlowDPS outperforms state-of-the-art alternatives, all without requiring additional training.

Jeongsol Kim, Bryan Sangwoo Kim, Jong Chul Ye• 2025

Related benchmarks

TaskDatasetResultRank
Gaussian DeblurringFFHQ
PSNR21.69
34
Gaussian DeblurringImageNet
SSIM0.485
32
Super-Resolution (4x)ImageNet
PSNR24.13
30
Motion DeblurringImageNet
SSIM0.513
27
Inpaint (box)ImageNet
PSNR23.21
26
Super-ResolutionImageNet
PSNR23.61
25
Super-ResolutionFFHQ 1k
FID36.07
23
Motion DeblurringFFHQ
PSNR22.16
22
InpaintingDIV2K 0.8k
PSNR25.44
14
InpaintingFFHQ 1k
PSNR30.36
14
Showing 10 of 22 rows

Other info

Follow for update