Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Revisiting Long-term Time Series Forecasting: An Investigation on Linear Mapping

About

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer can achieve competitive performance. This paper investigates the intrinsic effectiveness of recent LTSF approaches and reveals the critical role of affine mapping. Materials and methods: We conduct comprehensive experiments on both simulated and real-world datasets to analyze the components of state-of-the-art models. A theoretical analysis is provided to explain the working mechanisms of affine mapping in periodic signal forecasting. We evaluate the impact of reversible normalization and input horizon extension on model robustness. Results: We find that (1) affine mapping dominates forecasting performance across commonly utilized benchmarks, with models learning similar transition matrices from input to output; (2) affine mapping effectively captures periodic patterns but struggles with non-periodic signals or time series with varying periods across channels; (3) reversible normalization significantly enhances trend forecasting by transforming non-periodic trends into periodic-like patterns; (4) increasing input horizon improves performance on multi-channel data with different periods. Code is available at: \url{https://github.com/plumprc/RTSF}. Conclusions: Our findings provide theoretical and experimental insights into the working mechanisms of LTSF models, highlighting both the strengths and limitations of linear approaches. The results suggest that future model development should focus on handling cross-channel period variations and non-periodic components.

Zhe Li, Shiyi Qi, Yiduo Li, Zenglin Xu• 2023

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1
MSE0.366
836
Multivariate ForecastingETTh1
MSE0.2862
830
Time Series ForecastingETTh2
MSE0.262
796
Multivariate Time-series ForecastingETTm1
MSE0.31
686
Long-term time-series forecastingETTh1
MAE0.427
575
Multivariate Time-series ForecastingETTm2
MSE0.163
539
Time Series ForecastingETTm2
MSE0.162
536
Long-term time-series forecastingWeather
MSE0.192
525
Time Series ForecastingWeather
MSE0.143
497
Multivariate long-term forecastingETTh1
MSE0.386
472
Showing 10 of 150 rows
...

Other info

Code

Follow for update