Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Revisiting Long-term Time Series Forecasting: An Investigation on Linear Mapping

About

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer can achieve competitive performance. This paper investigates the intrinsic effectiveness of recent LTSF approaches and reveals the critical role of affine mapping. Materials and methods: We conduct comprehensive experiments on both simulated and real-world datasets to analyze the components of state-of-the-art models. A theoretical analysis is provided to explain the working mechanisms of affine mapping in periodic signal forecasting. We evaluate the impact of reversible normalization and input horizon extension on model robustness. Results: We find that (1) affine mapping dominates forecasting performance across commonly utilized benchmarks, with models learning similar transition matrices from input to output; (2) affine mapping effectively captures periodic patterns but struggles with non-periodic signals or time series with varying periods across channels; (3) reversible normalization significantly enhances trend forecasting by transforming non-periodic trends into periodic-like patterns; (4) increasing input horizon improves performance on multi-channel data with different periods. Code is available at: \url{https://github.com/plumprc/RTSF}. Conclusions: Our findings provide theoretical and experimental insights into the working mechanisms of LTSF models, highlighting both the strengths and limitations of linear approaches. The results suggest that future model development should focus on handling cross-channel period variations and non-periodic components.

Zhe Li, Shiyi Qi, Yiduo Li, Zenglin Xu• 2023

Related benchmarks

TaskDatasetResultRank
Multivariate ForecastingETTh1
MSE0.2862
909
Time Series ForecastingETTh1
MSE0.366
869
Time Series ForecastingETTh2
MSE0.262
796
Multivariate Time-series ForecastingETTm1
MSE0.31
742
Long-term time-series forecastingETTh1
MAE0.427
600
Multivariate Time-series ForecastingETTm2
MSE0.163
593
Time Series ForecastingETTm2
MSE0.162
552
Long-term time-series forecastingWeather
MSE0.192
527
Multivariate long-term forecastingETTh1
MSE0.386
509
Long-term forecastingETTh1
MSE0.446
500
Showing 10 of 155 rows
...

Other info

Code

Follow for update