TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-state
About
In long-term time series forecasting, different variables often influence the target variable over distinct time intervals, a challenge known as the multi-delay issue. Traditional models typically process all variables or time points uniformly, which limits their ability to capture complex variable relationships and obtain non-trivial time representations. To address this issue, we propose TimePro, an innovative Mamba-based model that constructs variate- and time-aware hyper-states. Unlike conventional approaches that merely transfer plain states across variable or time dimensions, TimePro preserves the fine-grained temporal features of each variate token and adaptively selects the focused time points to tune the plain state. The reconstructed hyper-state can perceive both variable relationships and salient temporal information, which helps the model make accurate forecasting. In experiments, TimePro performs competitively on eight real-world long-term forecasting benchmarks with satisfactory linear complexity. Code is available at https://github.com/xwmaxwma/TimePro.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multivariate Forecasting | ETTh1 | MSE0.438 | 645 | |
| Time Series Forecasting | ETTh1 | MSE0.438 | 601 | |
| Time Series Forecasting | ETTh2 | MSE0.377 | 438 | |
| Multivariate Time-series Forecasting | ETTm1 | MSE0.391 | 433 | |
| Time Series Forecasting | ETTm2 | MSE0.281 | 382 | |
| Multivariate long-term forecasting | ETTh1 | MSE0.375 | 344 | |
| Multivariate Forecasting | ETTh2 | MSE0.188 | 341 | |
| Time Series Forecasting | ETTm1 | MSE0.391 | 334 | |
| Multivariate Time-series Forecasting | ETTm2 | MSE0.281 | 334 | |
| Multivariate long-term series forecasting | ETTh2 | MSE0.377 | 319 |