Copula Conformal Prediction for Multi-step Time Series Forecasting
About
Accurate uncertainty measurement is a key step to building robust and reliable machine learning systems. Conformal prediction is a distribution-free uncertainty quantification algorithm popular for its ease of implementation, statistical coverage guarantees, and versatility for underlying forecasters. However, existing conformal prediction algorithms for time series are limited to single-step prediction without considering the temporal dependency. In this paper, we propose a Copula Conformal Prediction algorithm for multivariate, multi-step Time Series forecasting, CopulaCPTS. We prove that CopulaCPTS has finite sample validity guarantee. On several synthetic and real-world multivariate time series datasets, we show that CopulaCPTS produces more calibrated and sharp confidence intervals for multi-step prediction tasks than existing techniques.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Prediction Interval Estimation | Air 10 PM | Delta Cov-0.003 | 39 | |
| Prediction Interval Estimation | Air 25 PM | Delta Cov-0.004 | 39 | |
| Prediction Interval Estimation | Sap flow | Delta Cov-0.004 | 39 | |
| Multivariate Conformal Prediction | Wind dy=2 (test) | Coverage100 | 20 | |
| Multivariate Conformal Prediction | Wind dy=4 (test) | Coverage100 | 20 | |
| Multivariate Conformal Prediction | Wind dy=8 (test) | Coverage100 | 20 | |
| Multivariate Conformal Prediction | Traffic dy=2 (test) | Coverage100 | 20 | |
| Multivariate Conformal Prediction | Traffic dy=4 (test) | Coverage100 | 20 | |
| Multivariate Conformal Prediction | Traffic dy=8 (test) | Coverage100 | 20 | |
| Multivariate Conformal Prediction | Solar dy=2 (test) | Coverage100 | 20 |