Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patterns

About

The stable periodic patterns present in time series data serve as the foundation for conducting long-horizon forecasts. In this paper, we pioneer the exploration of explicitly modeling this periodicity to enhance the performance of models in long-term time series forecasting (LTSF) tasks. Specifically, we introduce the Residual Cycle Forecasting (RCF) technique, which utilizes learnable recurrent cycles to model the inherent periodic patterns within sequences, and then performs predictions on the residual components of the modeled cycles. Combining RCF with a Linear layer or a shallow MLP forms the simple yet powerful method proposed in this paper, called CycleNet. CycleNet achieves state-of-the-art prediction accuracy in multiple domains including electricity, weather, and energy, while offering significant efficiency advantages by reducing over 90% of the required parameter quantity. Furthermore, as a novel plug-and-play technique, the RCF can also significantly improve the prediction accuracy of existing models, including PatchTST and iTransformer. The source code is available at: https://github.com/ACAT-SCUT/CycleNet.

Shengsheng Lin, Weiwei Lin, Xinyi Hu, Wentai Wu, Ruichao Mo, Haocheng Zhong• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1
MSE0.375
729
Multivariate ForecastingETTh1
MSE0.375
686
Time Series ForecastingETTh2
MSE0.298
561
Multivariate Time-series ForecastingETTm1
MSE0.319
466
Long-term time-series forecastingWeather
MSE0.224
448
Long-term time-series forecastingETTh1
MAE0.396
446
Multivariate long-term forecastingETTh1
MSE0.432
394
Multivariate Time-series ForecastingETTm2
MSE0.163
389
Time Series ForecastingETTm2
MSE0.163
382
Long-term forecastingETTm1
MSE0.379
375
Showing 10 of 71 rows
...

Other info

Code

Follow for update