TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-state
About
In long-term time series forecasting, different variables often influence the target variable over distinct time intervals, a challenge known as the multi-delay issue. Traditional models typically process all variables or time points uniformly, which limits their ability to capture complex variable relationships and obtain non-trivial time representations. To address this issue, we propose TimePro, an innovative Mamba-based model that constructs variate- and time-aware hyper-states. Unlike conventional approaches that merely transfer plain states across variable or time dimensions, TimePro preserves the fine-grained temporal features of each variate token and adaptively selects the focused time points to tune the plain state. The reconstructed hyper-state can perceive both variable relationships and salient temporal information, which helps the model make accurate forecasting. In experiments, TimePro performs competitively on eight real-world long-term forecasting benchmarks with satisfactory linear complexity. Code is available at https://github.com/xwmaxwma/TimePro.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time Series Forecasting | ETTh1 | MSE0.438 | 729 | |
| Multivariate Forecasting | ETTh1 | MSE0.438 | 686 | |
| Time Series Forecasting | ETTh2 | MSE0.377 | 561 | |
| Multivariate Time-series Forecasting | ETTm1 | MSE0.391 | 466 | |
| Multivariate long-term forecasting | ETTh1 | MSE0.375 | 394 | |
| Multivariate Time-series Forecasting | ETTm2 | MSE0.281 | 389 | |
| Time Series Forecasting | ETTm2 | MSE0.281 | 382 | |
| Multivariate long-term series forecasting | ETTh2 | MSE0.377 | 367 | |
| Multivariate Forecasting | ETTh2 | MSE0.188 | 350 | |
| Multivariate Time-series Forecasting | Weather | MSE0.251 | 340 |