Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patterns

About

The stable periodic patterns present in time series data serve as the foundation for conducting long-horizon forecasts. In this paper, we pioneer the exploration of explicitly modeling this periodicity to enhance the performance of models in long-term time series forecasting (LTSF) tasks. Specifically, we introduce the Residual Cycle Forecasting (RCF) technique, which utilizes learnable recurrent cycles to model the inherent periodic patterns within sequences, and then performs predictions on the residual components of the modeled cycles. Combining RCF with a Linear layer or a shallow MLP forms the simple yet powerful method proposed in this paper, called CycleNet. CycleNet achieves state-of-the-art prediction accuracy in multiple domains including electricity, weather, and energy, while offering significant efficiency advantages by reducing over 90% of the required parameter quantity. Furthermore, as a novel plug-and-play technique, the RCF can also significantly improve the prediction accuracy of existing models, including PatchTST and iTransformer. The source code is available at: https://github.com/ACAT-SCUT/CycleNet.

Shengsheng Lin, Weiwei Lin, Xinyi Hu, Wentai Wu, Ruichao Mo, Haocheng Zhong• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1
MSE0.375
836
Multivariate ForecastingETTh1
MSE0.331
830
Time Series ForecastingETTh2
MSE0.298
796
Multivariate Time-series ForecastingETTm1
MSE0.319
686
Long-term time-series forecastingETTh1
MAE0.396
575
Multivariate Time-series ForecastingETTm2
MSE0.163
539
Time Series ForecastingETTm2
MSE0.163
536
Long-term time-series forecastingWeather
MSE0.224
525
Time Series ForecastingWeather
MSE0.224
497
Multivariate long-term forecastingETTh1
MSE0.432
472
Showing 10 of 96 rows
...

Other info

Code

Follow for update