Revisiting Long-term Time Series Forecasting: An Investigation on Linear Mapping
About
Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer can achieve competitive performance. This paper investigates the intrinsic effectiveness of recent LTSF approaches and reveals the critical role of affine mapping. Materials and methods: We conduct comprehensive experiments on both simulated and real-world datasets to analyze the components of state-of-the-art models. A theoretical analysis is provided to explain the working mechanisms of affine mapping in periodic signal forecasting. We evaluate the impact of reversible normalization and input horizon extension on model robustness. Results: We find that (1) affine mapping dominates forecasting performance across commonly utilized benchmarks, with models learning similar transition matrices from input to output; (2) affine mapping effectively captures periodic patterns but struggles with non-periodic signals or time series with varying periods across channels; (3) reversible normalization significantly enhances trend forecasting by transforming non-periodic trends into periodic-like patterns; (4) increasing input horizon improves performance on multi-channel data with different periods. Code is available at: \url{https://github.com/plumprc/RTSF}. Conclusions: Our findings provide theoretical and experimental insights into the working mechanisms of LTSF models, highlighting both the strengths and limitations of linear approaches. The results suggest that future model development should focus on handling cross-channel period variations and non-periodic components.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time Series Forecasting | ETTh1 | MSE0.366 | 836 | |
| Multivariate Forecasting | ETTh1 | MSE0.2862 | 830 | |
| Time Series Forecasting | ETTh2 | MSE0.262 | 796 | |
| Multivariate Time-series Forecasting | ETTm1 | MSE0.31 | 686 | |
| Long-term time-series forecasting | ETTh1 | MAE0.427 | 575 | |
| Multivariate Time-series Forecasting | ETTm2 | MSE0.163 | 539 | |
| Time Series Forecasting | ETTm2 | MSE0.162 | 536 | |
| Long-term time-series forecasting | Weather | MSE0.192 | 525 | |
| Time Series Forecasting | Weather | MSE0.143 | 497 | |
| Multivariate long-term forecasting | ETTh1 | MSE0.386 | 472 |