Learning Pattern-Specific Experts for Time Series Forecasting Under Patch-level Distribution Shift
About
Time series forecasting, which aims to predict future values based on historical data, has garnered significant attention due to its broad range of applications. However, real-world time series often exhibit complex non-uniform distribution with varying patterns across segments, such as season, operating condition, or semantic meaning, making accurate forecasting challenging. Existing approaches, which typically train a single model to capture all these diverse patterns, often struggle with the pattern drifts between patches and may lead to poor generalization. To address these challenges, we propose TFPS, a novel architecture that leverages pattern-specific experts for more accurate and adaptable time series forecasting. TFPS employs a dual-domain encoder to capture both time-domain and frequency-domain features, enabling a more comprehensive understanding of temporal dynamics. It then uses subspace clustering to dynamically identify distinct patterns across data patches. Finally, pattern-specific experts model these unique patterns, delivering tailored predictions for each patch. By explicitly learning and adapting to evolving patterns, TFPS achieves significantly improved forecasting accuracy. Extensive experiments on real-world datasets demonstrate that TFPS outperforms state-of-the-art methods, particularly in long-term forecasting, through its dynamic and pattern-aware learning approach. The data and codes are available: https://github.com/syrGitHub/TFPS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multivariate Forecasting | ETTh1 | MSE0.448 | 645 | |
| Multivariate Time-series Forecasting | ETTm1 | MSE0.395 | 433 | |
| Multivariate Forecasting | ETTh2 | MSE0.38 | 341 | |
| Multivariate Time-series Forecasting | ETTm2 | MSE0.276 | 334 | |
| Multivariate Time-series Forecasting | Weather | MSE0.241 | 276 | |
| Multivariate Time-series Forecasting | Exchange | MAE0.414 | 165 | |
| Multivariate Time-series Forecasting | ECL | MSE0.183 | 49 | |
| Multivariate long-term forecasting | ETTm1 T=96 (test) | MSE0.327 | 39 | |
| Multivariate Time-series Forecasting | Traffic S=720 (test) | MSE0.467 | 14 |