Automatic Posterior Transformation for Likelihood-Free Inference
About
How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional density estimators. However, existing methods are limited to a narrow range of proposal distributions or require importance weighting that can limit performance in practice. Here we present automatic posterior transformation (APT), a new sequential neural posterior estimation method for simulation-based inference. APT can modify the posterior estimate using arbitrary, dynamically updated proposals, and is compatible with powerful flow-based density estimators. It is more flexible, scalable and efficient than previous simulation-based inference techniques. APT can operate directly on high-dimensional time series and image data, opening up new applications for likelihood-free inference.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Continuous Ranked Probability Score (CRPS) Estimation | Lorenz-96 200 samples (test) | CRPS Component F0.593 | 11 | |
| Parameter Estimation | Multiscale Lorenz-96 (test) | Mean AP Error (F)11.29 | 11 | |
| Posterior Estimation | SBIBM SLCP | Joint C2ST90 | 10 | |
| Posterior Estimation | SBIBM Lotka–Volterra | Joint C2ST1 | 9 | |
| Posterior Estimation | SBIBM Two Moons | Joint C2ST61 | 9 | |
| Posterior Estimation | SBIBM Gaussian Mixture | Joint C2ST66 | 9 | |
| Posterior Estimation | SBIBM SIR | Joint C2ST68 | 9 | |
| Posterior Estimation | SBIBM Gaussian Linear | Joint C2ST0.55 | 8 | |
| Posterior Estimation | SBIBM Bernoulli GLM | Joint C2ST68 | 6 | |
| Simulation-Based Inference | SBIBM | Two Moons Performance54 | 6 |