Conformalized Quantile Regression
About
Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily conservative because they form intervals of constant or weakly varying length across the input space. In this paper we propose a new method that is fully adaptive to heteroscedasticity. It combines conformal prediction with classical quantile regression, inheriting the advantages of both. We establish a theoretical guarantee of valid coverage, supplemented by extensive experiments on popular regression datasets. We compare the efficiency of conformalized quantile regression to other conformal methods, showing that our method tends to produce shorter intervals.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Regression | Boston UCI (test) | -- | 32 | |
| Uncertainty Quantification | MSD Task01 (test) | Coverage (%)72.11 | 24 | |
| Conformal Prediction | 89_pegase (test) | PICP (Coverage)98.14 | 22 | |
| Object size area estimation | Nodule TN3K (100 random splits) | Interval Size7.48e+3 | 18 | |
| Object size area estimation | H&E 100 random splits | Interval Size5.65e+3 | 18 | |
| Conformal Prediction | meps 21 (test) | Average Length2.585 | 18 | |
| Object size area estimation | PolyP (100 random splits) | Interval Size8.16e+3 | 18 | |
| Object size area estimation | Skin Lesion (100 random splits) | Interval Size2.63e+3 | 18 | |
| Regression | Abalone | -- | 18 | |
| Conformal Prediction | Synthetic Data sample size 5000 (test) | Marginal Coverage90 | 16 |