Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Optimal Conformal Prediction for Small Areas

About

Existing inferential methods for small area data involve a trade-off between maintaining area-level frequentist coverage rates and improving inferential precision via the incorporation of indirect information. In this article, we propose a method to obtain an area-level prediction region for a future observation which mitigates this trade-off. The proposed method takes a conformal prediction approach in which the conformity measure is the posterior predictive density of a working model that incorporates indirect information. The resulting prediction region has guaranteed frequentist coverage regardless of the working model, and, if the working model assumptions are accurate, the region has minimum expected volume compared to other regions with the same coverage rate. When constructed under a normal working model, we prove such a prediction region is an interval and construct an efficient algorithm to obtain the exact interval. We illustrate the performance of our method through simulation studies and an application to EPA radon survey data.

Elizabeth Bersson, Peter D. Hoff• 2022

Related benchmarks

TaskDatasetResultRank
Conformal PredictionVentricularVolume (OUT)
Interval Width3.856
35
Image RegressionUTKFaces In-distribution
Interval Width2.919
28
RegressionVentricularVolume (in-distribution)
Interval Width2.528
28
Image RegressionUTKFaces Out-of-distribution
Interval Width4.677
28
Prediction interval computationFacebook 1 tabular (c=0)
Throughput (trials/s)7.39
9
Prediction interval computationAirfoil (c=0)
Trials per Second11.31
9
Prediction interval computationConcrete tabular c=0
Throughput (trials/s)12.79
9
Prediction interval computationVentricularVolume image (in-distribution)
Throughput (trials/s)3.64e+3
7
Prediction interval computationUTKFaces In-distribution
Trials per Second2.61e+3
7
Conformal PredictionUTKFaces (OUT)
Interval Width4.598
7
Showing 10 of 12 rows

Other info

Follow for update