MSHyper: Multi-Scale Hypergraph Transformer for Long-Range Time Series Forecasting
About
Demystifying interactions between temporal patterns of different scales is fundamental to precise long-range time series forecasting. However, previous works lack the ability to model high-order interactions. To promote more comprehensive pattern interaction modeling for long-range time series forecasting, we propose a Multi-Scale Hypergraph Transformer (MSHyper) framework. Specifically, a multi-scale hypergraph is introduced to provide foundations for modeling high-order pattern interactions. Then by treating hyperedges as nodes, we also build a hyperedge graph to enhance hypergraph modeling. In addition, a tri-stage message passing mechanism is introduced to aggregate pattern information and learn the interaction strength between temporal patterns of different scales. Extensive experiments on five real-world datasets demonstrate that MSHyper achieves state-of-the-art (SOTA) performance across various settings.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multivariate Forecasting | ETTh1 | MSE0.696 | 645 | |
| Time Series Forecasting | ETTh1 | MSE0.557 | 601 | |
| Multivariate Time-series Forecasting | ETTm1 | MSE0.468 | 433 | |
| Multivariate long-term forecasting | ETTh1 | MSE0.454 | 344 | |
| Multivariate Forecasting | ETTh2 | MSE0.541 | 341 | |
| Multivariate Time-series Forecasting | ETTm2 | MSE0.446 | 334 | |
| Multivariate long-term series forecasting | ETTh2 | MSE0.383 | 319 | |
| Multivariate long-term series forecasting | Weather | MSE0.17 | 288 | |
| Long-term time-series forecasting | Traffic | MSE0.428 | 278 | |
| Multivariate long-term series forecasting | ETTm1 | MSE0.407 | 257 |