Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecasting

About

Time series forecasting is crucial for various applications, such as weather forecasting, power load forecasting, and financial analysis. In recent studies, MLP-mixer models for time series forecasting have been shown as a promising alternative to transformer-based models. However, the performance of these models is still yet to reach its potential. In this paper, we propose Wavelet Patch Mixer (WPMixer), a novel MLP-based model, for long-term time series forecasting, which leverages the benefits of patching, multi-resolution wavelet decomposition, and mixing. Our model is based on three key components: (i) multi-resolution wavelet decomposition, (ii) patching and embedding, and (iii) MLP mixing. Multi-resolution wavelet decomposition efficiently extracts information in both the frequency and time domains. Patching allows the model to capture an extended history with a look-back window and enhances capturing local information while MLP mixing incorporates global information. Our model significantly outperforms state-of-the-art MLP-based and transformer-based models for long-term time series forecasting in a computationally efficient way, demonstrating its efficacy and potential for practical applications.

Md Mahmuddun Nabi Murad, Mehmet Aktukmak, Yasin Yilmaz• 2024

Related benchmarks

TaskDatasetResultRank
Long-term time-series forecastingETTh1
MAE0.399
351
Long-term time-series forecastingETTh1 (test)
MSE0.368
221
Long-term time-series forecastingWeather (test)
MSE0.162
103
Long-term time-series forecastingETTh2 (test)
MSE0.282
92
Long-term time-series forecastingETTm1 (test)
MSE0.314
81
Fluid Dynamics PredictionChannel (test)
MAE0.031
20
Fluid Dynamics PredictionLow-Re (test)
MAE0.0189
20
Fluid Dynamics PredictionDam (test)
MAE0.0338
20
Fluid Dynamics PredictionHigh-Re (test)
MAE0.1385
20
Fluid Dynamics PredictionCavity (test)
MAE0.0276
20
Showing 10 of 11 rows

Other info

Follow for update