Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Solving Inverse Problems via Diffusion Optimal Control

About

Existing approaches to diffusion-based inverse problem solvers frame the signal recovery task as a probabilistic sampling episode, where the solution is drawn from the desired posterior distribution. This framework suffers from several critical drawbacks, including the intractability of the conditional likelihood function, strict dependence on the score network approximation, and poor $\mathbf{x}_0$ prediction quality. We demonstrate that these limitations can be sidestepped by reframing the generative process as a discrete optimal control episode. We derive a diffusion-based optimal controller inspired by the iterative Linear Quadratic Regulator (iLQR) algorithm. This framework is fully general and able to handle any differentiable forward measurement operator, including super-resolution, inpainting, Gaussian deblurring, nonlinear deblurring, and even highly nonlinear neural classifiers. Furthermore, we show that the idealized posterior sampling equation can be recovered as a special case of our algorithm. We then evaluate our method against a selection of neural inverse problem solvers, and establish a new baseline in image reconstruction with inverse problems.

Henry Li, Marcus Pereira• 2024

Related benchmarks

TaskDatasetResultRank
4x super-resolutionFFHQ 256x256
PSNR27.15
61
Gaussian DeblurringFFHQ 256x256-1K
FID31.8
37
Box InpaintingFFHQ 256x256-1K
FID20.22
36
Motion DeblurringFFHQ 256x256-1K
FID39.4
34
Random InpaintingFFHQ 256x256-1K
FID15.93
32
Motion DeblurFFHQ 256x256
LPIPS0.199
25
Inpaint (random)FFHQ 256 x 256
PSNR27.7
21
Super-ResolutionFFHQ 256x256-1K
FID32.47
11
Image Super-resolutionFFHQ 1,000 randomly selected images (test)
PSNR26.7617
11
Image DeblurringFFHQ 1,000 images (test)
PSNR25.2189
11
Showing 10 of 15 rows

Other info

Code

Follow for update