Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Is Mamba Effective for Time Series Forecasting?

About

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in TSF, primarily attributed to their advantage in apprehending these patterns. However, the quadratic complexity of the Transformer leads to low computational efficiency and high costs, which somewhat hinders the deployment of the TSF model in real-world scenarios. Recently, Mamba, a selective state space model, has gained traction due to its ability to process dependencies in sequences while maintaining near-linear complexity. For TSF tasks, these characteristics enable Mamba to comprehend hidden patterns as the Transformer and reduce computational overhead compared to the Transformer. Therefore, we propose a Mamba-based model named Simple-Mamba (S-Mamba) for TSF. Specifically, we tokenize the time points of each variate autonomously via a linear layer. A bidirectional Mamba layer is utilized to extract inter-variate correlations and a Feed-Forward Network is set to learn temporal dependencies. Finally, the generation of forecast outcomes through a linear mapping layer. Experiments on thirteen public datasets prove that S-Mamba maintains low computational overhead and achieves leading performance. Furthermore, we conduct extensive experiments to explore Mamba's potential in TSF tasks. Our code is available at https://github.com/wzhwzhwzh0921/S-D-Mamba.

Zihan Wang, Fanheng Kong, Shi Feng, Ming Wang, Xiaocui Yang, Han Zhao, Daling Wang, Yifei Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1
MSE0.386
836
Multivariate ForecastingETTh1
MSE0.455
830
Time Series ForecastingETTh2
MSE0.296
796
Multivariate Time-series ForecastingETTm1
MSE0.398
686
Multivariate Time-series ForecastingETTm2
MSE0.288
539
Time Series ForecastingETTm2
MSE0.179
536
Long-term time-series forecastingWeather
MSE0.165
525
Time Series ForecastingWeather
MSE0.206
497
Multivariate long-term forecastingETTh1
MSE0.388
472
Long-term time-series forecastingETTh2
MSE0.381
461
Showing 10 of 93 rows
...

Other info

Code

Follow for update