SeesawNet: Towards Non-stationary Time Series Forecasting with Balanced Modeling of Common and Specific Dependencies
About
Instance normalization (IN) is widely used in non-stationary multivariate time series forecasting to reduce distribution shifts and highlight common patterns across samples. However, IN can over-smooth instance-specific structural information that is essential for modeling temporal and cross-channel heterogeneity. While prior methods further suppress distribution discrepancies or attempt to recover temporal specific dependencies, they often ignore a central tension: how to adaptively model common and instance-specific dependency based on each instance's non-stationary structures. To address this dilemma, we propose SeesawNet, a unified architecture that dynamically balances common and instance-specific dependency modeling in both temporal and channel dimensions. At its core is Adaptive Stationary-Nonstationary Attention (ASNA), which captures common dependencies from normalized sequences and specific dependencies from raw sequences, and adaptively fuses them according to instance-level non-stationarity. Built upon ASNA, SeesawNet alternates dedicated temporal and channel relationship modeling to jointly capture long-range and cross-variable dependencies. Extensive experiments on multiple real-world benchmarks demonstrate that SeesawNet consistently outperforms state-of-the-art methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multivariate long-term forecasting | ETTh1 | MSE0.353 | 472 | |
| Multivariate long-term series forecasting | ETTh2 | MSE0.258 | 445 | |
| Multivariate long-term series forecasting | Weather | MSE0.142 | 425 | |
| Multivariate long-term series forecasting | ETTm1 | MSE0.293 | 383 | |
| Multivariate long-term series forecasting | ETTm2 | MSE0.16 | 301 | |
| Multivariate long-term series forecasting | Exchange | MSE0.088 | 156 | |
| Multi-variate long-term time series forecasting | solar | MSE0.158 | 144 | |
| Multivariate long-term forecasting | ECL | MSE0.128 | 109 | |
| Multivariate long-term forecasting | ILI | MSE1.562 | 60 |