Automatic Posterior Transformation for Likelihood-Free Inference
About
How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional density estimators. However, existing methods are limited to a narrow range of proposal distributions or require importance weighting that can limit performance in practice. Here we present automatic posterior transformation (APT), a new sequential neural posterior estimation method for simulation-based inference. APT can modify the posterior estimate using arbitrary, dynamically updated proposals, and is compatible with powerful flow-based density estimators. It is more flexible, scalable and efficient than previous simulation-based inference techniques. APT can operate directly on high-dimensional time series and image data, opening up new applications for likelihood-free inference.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Bayesian Inference | Bayesian Inverse Problems Task 3 1.0 | C2ST66.6 | 17 | |
| Bayesian Inference | Bayesian Inverse Problems Task 1 1.0 | C2ST50.7 | 17 | |
| Bayesian Inference | Bayesian Inverse Problems Task 4 1.0 | C2ST53.3 | 17 | |
| Bayesian Inference | Bayesian Inverse Problems Task 2 1.0 | C2ST50.7 | 17 | |
| Bayesian Inference | Bayesian Inverse Problems Task 5 1.0 | C2ST53 | 17 | |
| Continuous Ranked Probability Score (CRPS) Estimation | Lorenz-96 200 samples (test) | CRPS Component F0.593 | 11 | |
| Parameter Estimation | Multiscale Lorenz-96 (test) | Mean AP Error (F)11.29 | 11 | |
| Posterior Estimation | SBIBM SLCP | Joint C2ST90 | 10 | |
| Posterior Estimation | SBIBM Lotka–Volterra | Joint C2ST1 | 9 | |
| Posterior Estimation | SBIBM Two Moons | Joint C2ST61 | 9 |