CATS: Enhancing Multivariate Time Series Forecasting by Constructing Auxiliary Time Series as Exogenous Variables
About
For Multivariate Time Series Forecasting (MTSF), recent deep learning applications show that univariate models frequently outperform multivariate ones. To address the difficiency in multivariate models, we introduce a method to Construct Auxiliary Time Series (CATS) that functions like a 2D temporal-contextual attention mechanism, which generates Auxiliary Time Series (ATS) from Original Time Series (OTS) to effectively represent and incorporate inter-series relationships for forecasting. Key principles of ATS - continuity, sparsity, and variability - are identified and implemented through different modules. Even with a basic 2-layer MLP as core predictor, CATS achieves state-of-the-art, significantly reducing complexity and parameters compared to previous multivariate models, marking it an efficient and transferable MTSF solution.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multivariate Time-series Forecasting | Electricity 96 | MSE0.125 | 20 | |
| Multivariate Time-series Forecasting | Electricity 192 | MSE0.142 | 20 | |
| Multivariate Time-series Forecasting | Electricity 720 | MSE0.174 | 20 | |
| Multivariate Time-series Forecasting | ETTm1 96 | MSE0.282 | 20 | |
| Multivariate Time-series Forecasting | ETTm1 336 | MSE0.358 | 20 | |
| Multivariate Time-series Forecasting | ETTm2 336 | MSE0.264 | 20 | |
| Multivariate Time-series Forecasting | ETTh2 720 | MSE0.358 | 20 | |
| Multivariate Time-series Forecasting | Traffic 720 | MSE0.421 | 20 | |
| Multivariate Time-series Forecasting | Electricity 336 | MSE0.155 | 20 | |
| Multivariate Time-series Forecasting | ETTh1 96 | MSE0.365 | 20 |