Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

A comparison of some conformal quantile regression methods

About

We compare two recently proposed methods that combine ideas from conformal inference and quantile regression to produce locally adaptive and marginally valid prediction intervals under sample exchangeability (Romano et al., 2019; Kivaranovic et al., 2019). First, we prove that these two approaches are asymptotically efficient in large samples, under some additional assumptions. Then we compare them empirically on simulated and real data. Our results demonstrate that the method in Romano et al. (2019) typically yields tighter prediction intervals in finite samples. Finally, we discuss how to tune these procedures by fixing the relative proportions of observations used for training and conformalization.

Matteo Sesia, Emmanuel J. Cand\`es• 2019

Related benchmarks

TaskDatasetResultRank
Conformal Prediction89_pegase (test)
PICP (Coverage)97.79
22
Conformal Prediction118_ieee (test)
PICP0.9783
10
Regressionmeps 19 (test)--
10
Uncertainty Quantization118_ieee 1999 (test)
PICP (%)90.88
8
Uncertainty Quantization1354_pegase 2013 (test)
PICP (%)91.57
8
Uncertainty Quantization89_pegase 2013 (test)
PICP (%)90.71
8
Regressionhomes--
8
Regressionconcrete n=1030 (test)
ILR0.73
7
RegressionSTAR
SMIS11.33
7
Regressionhomes n=21613 (test)
ILR1.4
7
Showing 10 of 45 rows

Other info

Follow for update