Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Error-quantified Conformal Inference for Time Series

About

Uncertainty quantification in time series prediction is challenging due to the temporal dependence and distribution shift on sequential data. Conformal inference provides a pivotal and flexible instrument for assessing the uncertainty of machine learning models through prediction sets. Recently, a series of online conformal inference methods updated thresholds of prediction sets by performing online gradient descent on a sequence of quantile loss functions. A drawback of such methods is that they only use the information of revealed non-conformity scores via miscoverage indicators but ignore error quantification, namely the distance between the non-conformity score and the current threshold. To accurately leverage the dynamic of miscoverage error, we propose \textit{Error-quantified Conformal Inference} (ECI) by smoothing the quantile loss function. ECI introduces a continuous and adaptive feedback scale with the miscoverage error, rather than simple binary feedback in existing methods. We establish a long-term coverage guarantee for ECI under arbitrary dependence and distribution shift. The extensive experimental results show that ECI can achieve valid miscoverage control and output tighter prediction sets than other baselines.

Junxi Wu, Dongjian Hu, Yajie Bao, Shu-Tao Xia, Changliang Zou• 2025

Related benchmarks

TaskDatasetResultRank
Time-series interval forecastingAmazon Stock
Coverage90.1
24
Post-shift coverage recoveryChangepoint Shift 1 (Time 1)
Recovery Time12
24
Conformal PredictionChangepoint simulated (test)
Coverage89.9
24
Time-series interval forecastingGoogle Stock
Coverage89.9
24
Online Conformal PredictionDistribution Drift
Coverage90.1
24
Post-shift coverage recoveryChangepoint Shift 2 (Time 2)
Recovery Time0.00e+0
24
Time-series interval forecastingTemperature
Coverage90.1
24
Conformal PredictionDistribution Drift simulated (test)
Coverage90.2
24
Time-series interval forecastingElectricity Demand
Coverage90
24
Online Conformal PredictionVariance Changepoint
Coverage0.899
24
Showing 10 of 11 rows

Other info

Follow for update