Conformalized Quantile Regression
About
Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily conservative because they form intervals of constant or weakly varying length across the input space. In this paper we propose a new method that is fully adaptive to heteroscedasticity. It combines conformal prediction with classical quantile regression, inheriting the advantages of both. We establish a theoretical guarantee of valid coverage, supplemented by extensive experiments on popular regression datasets. We compare the efficiency of conformalized quantile regression to other conformal methods, showing that our method tends to produce shorter intervals.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Regression | Boston UCI (test) | -- | 26 | |
| Conformal Prediction | 89_pegase (test) | PICP (Coverage)98.14 | 22 | |
| Conformal Prediction | meps 21 (test) | Average Length2.585 | 18 | |
| Conformal Prediction | Synthetic Data sample size 5000 (test) | Marginal Coverage90 | 16 | |
| Conformal Prediction | Bio (test) | Marginal Coverage90 | 14 | |
| Conformal Prediction | fb1 (test) | Marginal Coverage90 | 14 | |
| Conformal Prediction | fb2 (test) | Marginal Coverage90 | 14 | |
| Conformal Prediction | meps19 (test) | Marginal Coverage90 | 14 | |
| Conformal Prediction | blog (test) | Marginal Coverage0.9 | 14 | |
| Spatio-temporal Interval Prediction | NYCbike (January) | Coverage90 | 14 |