Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Learning Pattern-Specific Experts for Time Series Forecasting Under Patch-level Distribution Shift

About

Time series forecasting, which aims to predict future values based on historical data, has garnered significant attention due to its broad range of applications. However, real-world time series often exhibit complex non-uniform distribution with varying patterns across segments, such as season, operating condition, or semantic meaning, making accurate forecasting challenging. Existing approaches, which typically train a single model to capture all these diverse patterns, often struggle with the pattern drifts between patches and may lead to poor generalization. To address these challenges, we propose TFPS, a novel architecture that leverages pattern-specific experts for more accurate and adaptable time series forecasting. TFPS employs a dual-domain encoder to capture both time-domain and frequency-domain features, enabling a more comprehensive understanding of temporal dynamics. It then uses subspace clustering to dynamically identify distinct patterns across data patches. Finally, pattern-specific experts model these unique patterns, delivering tailored predictions for each patch. By explicitly learning and adapting to evolving patterns, TFPS achieves significantly improved forecasting accuracy. Extensive experiments on real-world datasets demonstrate that TFPS outperforms state-of-the-art methods, particularly in long-term forecasting, through its dynamic and pattern-aware learning approach. The data and codes are available: https://github.com/syrGitHub/TFPS.

Yanru Sun, Zongxia Xie, Emadeldeen Eldele, Dongyue Chen, Qinghua Hu, Min Wu• 2024

Related benchmarks

TaskDatasetResultRank
Multivariate ForecastingETTh1
MSE0.448
645
Multivariate Time-series ForecastingETTm1
MSE0.395
433
Multivariate ForecastingETTh2
MSE0.38
341
Multivariate Time-series ForecastingETTm2
MSE0.276
334
Multivariate Time-series ForecastingWeather
MSE0.241
276
Multivariate Time-series ForecastingExchange
MAE0.414
165
Multivariate Time-series ForecastingECL
MSE0.183
49
Multivariate long-term forecastingETTm1 T=96 (test)
MSE0.327
39
Multivariate Time-series ForecastingTraffic S=720 (test)
MSE0.467
14
Showing 9 of 9 rows

Other info

Follow for update