CATS: Enhancing Multivariate Time Series Forecasting by Constructing Auxiliary Time Series as Exogenous Variables
About
For Multivariate Time Series Forecasting (MTSF), recent deep learning applications show that univariate models frequently outperform multivariate ones. To address the difficiency in multivariate models, we introduce a method to Construct Auxiliary Time Series (CATS) that functions like a 2D temporal-contextual attention mechanism, which generates Auxiliary Time Series (ATS) from Original Time Series (OTS) to effectively represent and incorporate inter-series relationships for forecasting. Key principles of ATS - continuity, sparsity, and variability - are identified and implemented through different modules. Even with a basic 2-layer MLP as core predictor, CATS achieves state-of-the-art, significantly reducing complexity and parameters compared to previous multivariate models, marking it an efficient and transferable MTSF solution.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multivariate Time-series Forecasting | ETTH1 FL=720 | MSE0.441 | 11 | |
| Multivariate Time-series Forecasting | ETTH1 FL=336 | MSE0.423 | 11 | |
| Multivariate Time-series Forecasting | Multi20 96 (test) | MSE0.003 | 8 | |
| Multivariate Time-series Forecasting | Multi20 192 (test) | MSE0.011 | 8 | |
| Multivariate Time-series Forecasting | Multi20 336 (test) | MSE0.015 | 8 | |
| Multivariate Time-series Forecasting | Multi50 96 (test) | MSE0.004 | 8 | |
| Multivariate Time-series Forecasting | Multi50 192 (test) | MSE0.009 | 8 | |
| Multivariate Time-series Forecasting | Multi50 336 (test) | MSE0.018 | 8 | |
| Multivariate Time-series Forecasting | Multi100 96 (test) | MSE0.003 | 8 | |
| Multivariate Time-series Forecasting | Multi100 192 (test) | MSE0.008 | 8 |