Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CP4SBI: Local Conformal Calibration of Credible Sets in Simulation-Based Inference

About

Current experimental scientists have been increasingly relying on simulation-based inference (SBI) to invert complex non-linear models with intractable likelihoods. However, posterior approximations obtained with SBI are often miscalibrated, causing credible regions to undercover true parameters. We develop $\texttt{CP4SBI}$, a model-agnostic conformal calibration framework that constructs credible sets with local Bayesian coverage. Our two proposed variants, namely local calibration via regression trees and CDF-based calibration, enable finite-sample local coverage guarantees for any scoring function, including HPD, symmetric, and quantile-based regions. Experiments on widely used SBI benchmarks demonstrate that our approach improves the quality of uncertainty quantification for neural posterior estimators using both normalizing flows and score-diffusion modeling.

Luben M. C. Cabezas, Vagner S. Santos, Thiago R. Ramos, Pedro L. C. Rodrigues, Rafael Izbicki• 2025

Related benchmarks

TaskDatasetResultRank
Posterior EstimationTwo Moons
Area of HPD Region0.038
10
Posterior EstimationGaussian Mixture
Area of HPD Region9.504
10
Posterior EstimationSIR
Area of HPD region0.039
10
Showing 3 of 3 rows

Other info

Follow for update