Battling the Non-stationarity in Time Series Forecasting via Test-time Adaptation
About
Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained source time series forecasters in mission-critical deployment settings. In this study, we introduce a pioneering test-time adaptation framework tailored for TSF (TSF-TTA). TAFAS, the proposed approach to TSF-TTA, flexibly adapts source forecasters to continuously shifting test distributions while preserving the core semantic information learned during pre-training. The novel utilization of partially-observed ground truth and gated calibration module enables proactive, robust, and model-agnostic adaptation of source forecasters. Experiments on diverse benchmark datasets and cutting-edge architectures demonstrate the efficacy and generality of TAFAS, especially in long-term forecasting scenarios that suffer from significant distribution shifts. The code is available at https://github.com/kimanki/TAFAS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time Series Forecasting | ETTh1 | MSE0.476 | 601 | |
| Time Series Forecasting | ETTh2 | MSE0.402 | 438 | |
| Time Series Forecasting | ETTm2 | MSE0.288 | 382 | |
| Time Series Forecasting | ETTm1 | MSE0.411 | 334 | |
| Time Series Forecasting | Exchange | MSE0.363 | 176 | |
| Time Series Forecasting | Weather | MSE0.256 | 25 | |
| Time Series Forecasting | Traffic | MSE0.455 | 16 | |
| Time Series Forecasting | ELC | MSE0.182 | 16 | |
| Time Series Forecasting | ELC Length 96 (test) | Error0.156 | 14 |