Blade: A Derivative-free Bayesian Inversion Method using Diffusion Priors
About
Derivative-free Bayesian inversion arises in science and engineering applications, particularly when forward model is costly or infeasible to differentiate through. Existing derivative-free methods collapse the posterior to a point estimate or return severely over-confident uncertainty on high-dimensional, nonlinear problems. We introduce Blade, which produces accurate and well-calibrated posteriors using an ensemble of interacting particles. Blade leverages diffusion models as data-driven priors, and only queries the forward model through forward evaluations (i.e., derivative-free). Theoretically, we show the convergence and stability of Blade under forward model approximation and prior score estimation error. Empirically, on nonlinear fluid dynamics, Blade produces well-calibrated posterior samples that existing derivative-free methods cannot, as measured by CRPS, the spread-skill ratio, and the rank histogram. Its accuracy and calibration improve consistently with more iterations and particles, backed by our convergence and stability analysis and empirical experiments.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Posterior Sampling | Linear Gaussian n=2 | SWD1.678 | 24 | |
| Posterior Sampling | Linear Gaussian n=80 | SWD4.284 | 24 | |
| Posterior Sampling | Linear Gaussian n=400 | SWD4.074 | 24 | |
| Black Hole Imaging | InverseBench Black-Hole Imaging (test) | PSNR31.3 | 17 | |
| Phase Retrieval | FFHQ 256x256 (test) | LPIPS0.263 | 16 | |
| Inverse Problem | InverseBench Navier-Stokes (sigma_noise=0) (test) | Relative L2 Error0.08 | 13 | |
| Inverse Problem | InverseBench Navier-Stokes (sigma_noise=1.0) (test) | Relative L2 Error0.162 | 13 | |
| Inverse Problem | InverseBench Navier-Stokes (sigma_noise=2.0) (test) | Relative L2 Error0.217 | 13 | |
| Image Inpainting | FFHQ 256x256 (test) | PSNR24.07 | 8 |