U-Mixer: An Unet-Mixer Architecture with Stationarity Correction for Time Series Forecasting
About
Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers, disrupts feature distributions, and complicates learning data distribution changes. As a result, many existing models struggle to capture the underlying patterns, leading to degraded forecasting performance. In this study, we tackle the challenge of non-stationarity in time series forecasting with our proposed framework called U-Mixer. By combining Unet and Mixer, U-Mixer effectively captures local temporal dependencies between different patches and channels separately to avoid the influence of distribution variations among channels, and merge low- and high-levels features to obtain comprehensive data representations. The key contribution is a novel stationarity correction method, explicitly restoring data distribution by constraining the difference in stationarity between the data before and after model processing to restore the non-stationarity information, while ensuring the temporal dependencies are preserved. Through extensive experiments on various real-world time series datasets, U-Mixer demonstrates its effectiveness and robustness, and achieves 14.5\% and 7.7\% improvements over state-of-the-art (SOTA) methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multivariate long-term forecasting | ETTh1 | MSE0.37 | 472 | |
| Multivariate long-term series forecasting | ETTh2 | MSE0.291 | 445 | |
| Multivariate long-term series forecasting | Weather | MSE0.159 | 425 | |
| Multivariate long-term series forecasting | ETTm1 | MSE0.321 | 383 | |
| Multivariate long-term series forecasting | ETTm2 | MSE0.176 | 301 | |
| Multivariate long-term series forecasting | Exchange | MSE0.087 | 156 | |
| Multi-variate long-term time series forecasting | solar | MSE0.187 | 144 | |
| Multivariate long-term forecasting | ECL | MSE0.168 | 109 | |
| Multivariate long-term forecasting | ILI | MSE2.398 | 60 |