Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Conformal PID Control for Time Series Prediction

About

We study the problem of uncertainty quantification for time series prediction, with the goal of providing easy-to-use algorithms with formal guarantees. The algorithms we present build upon ideas from conformal prediction and control theory, are able to prospectively model conformal scores in an online setting, and adapt to the presence of systematic errors due to seasonality, trends, and general distribution shifts. Our theory both simplifies and strengthens existing analyses in online conformal prediction. Experiments on 4-week-ahead forecasting of statewide COVID-19 death counts in the U.S. show an improvement in coverage over the ensemble forecaster used in official CDC communications. We also run experiments on predicting electricity demand, market returns, and temperature using autoregressive, Theta, Prophet, and Transformer models. We provide an extendable codebase for testing our methods and for the integration of new algorithms, data sets, and forecasting rules.

Anastasios N. Angelopoulos, Emmanuel J. Candes, Ryan J. Tibshirani• 2023

Related benchmarks

TaskDatasetResultRank
Time-series interval forecastingElectricity Demand
Coverage90.1
24
Post-shift coverage recoveryChangepoint Shift 1 (Time 1)
Recovery Time12
24
Time-series interval forecastingGoogle Stock
Coverage90.1
24
Time-series interval forecastingTemperature
Coverage90.1
24
Post-shift coverage recoveryChangepoint Shift 2 (Time 2)
Recovery Time0.00e+0
24
Time-series interval forecastingAmazon Stock
Coverage89.8
24
Conformal PredictionChangepoint simulated (test)
Coverage89.9
24
Online Conformal PredictionDistribution Drift
Coverage89.7
24
Online Conformal PredictionVariance Changepoint
Coverage0.897
24
Online Conformal PredictionHeavy-tailed
Coverage89.7
24
Showing 10 of 19 rows

Other info

Follow for update