Copula Conformal Prediction for Multi-step Time Series Forecasting
About
Accurate uncertainty measurement is a key step to building robust and reliable machine learning systems. Conformal prediction is a distribution-free uncertainty quantification algorithm popular for its ease of implementation, statistical coverage guarantees, and versatility for underlying forecasters. However, existing conformal prediction algorithms for time series are limited to single-step prediction without considering the temporal dependency. In this paper, we propose a Copula Conformal Prediction algorithm for multivariate, multi-step Time Series forecasting, CopulaCPTS. We prove that CopulaCPTS has finite sample validity guarantee. On several synthetic and real-world multivariate time series datasets, we show that CopulaCPTS produces more calibrated and sharp confidence intervals for multi-step prediction tasks than existing techniques.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Prediction Interval Estimation | Air 10 PM | Delta Cov-0.003 | 39 | |
| Prediction Interval Estimation | Air 25 PM | Delta Cov-0.004 | 39 | |
| Prediction Interval Estimation | Sap flow | Delta Cov-0.004 | 39 | |
| Time Series Conformal Prediction | Solar 3Y (test) | Delta Covariance0.00e+0 | 19 | |
| Uncertainty Estimation | Solar 1Y (test) | $Δ$ Cov0.002 | 8 | |
| Conformal Prediction | Streamflow alpha=0.05 (test) | Δ Cov0.003 | 7 | |
| Conformal Prediction | Streamflow alpha=0.10 (test) | Delta Cov0.005 | 7 | |
| Conformal Prediction | Streamflow alpha=0.15 (test) | Delta Coverage0.5 | 7 | |
| Time Series Conformal Prediction | Sap flow (test) | Delta Coverage-0.251 | 3 |