Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Probabilistic Conformal Prediction Using Conditional Random Samples

About

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from an estimated generative model. It is efficient and compatible with either explicit or implicit conditional generative models. Theoretically, we show that PCP guarantees correct marginal coverage with finite samples. Empirically, we study PCP on a variety of simulated and real datasets. Compared to existing methods for conformal inference, PCP provides sharper predictive sets.

Zhendong Wang, Ruijiang Gao, Mingzhang Yin, Mingyuan Zhou, David M. Blei• 2022

Related benchmarks

TaskDatasetResultRank
Conformal PredictionCASP
Volume63
23
Conformal PredictionHouse
Volume63
23
Conformal PredictionBias
Volume1.54
23
Conformal PredictionRF1
Volume52
22
Conformal PredictionRF2
Volume47
22
Conformal PredictionBio (test)
Marginal Coverage90
19
Prediction Region EstimationEnergy (test)
Coverage89.5
16
Conformal PredictionBIKE
Empirical Coverage90
12
Conformal Predictiontaxi
Volume0.003
11
Conditional Coverage for Partially Revealed Outputstaxi
ERT (%)4.84
11
Showing 10 of 65 rows

Other info

Follow for update