Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis

About

Time series analysis plays a critical role in numerous applications, supporting tasks such as forecasting, classification, anomaly detection, and imputation. In this work, we present the time series pattern machine (TSPM), a model designed to excel in a broad range of time series tasks through powerful representation and pattern extraction capabilities. Traditional time series models often struggle to capture universal patterns, limiting their effectiveness across diverse tasks. To address this, we define multiple scales in the time domain and various resolutions in the frequency domain, employing various mixing strategies to extract intricate, task-adaptive time series patterns. Specifically, we introduce a general-purpose TSPM that processes multi-scale time series using (1) multi-resolution time imaging (MRTI), (2) time image decomposition (TID), (3) multi-scale mixing (MCM), and (4) multi-resolution mixing (MRM) to extract comprehensive temporal patterns. MRTI transforms multi-scale time series into multi-resolution time images, capturing patterns across both temporal and frequency domains. TID leverages dual-axis attention to extract seasonal and trend patterns, while MCM hierarchically aggregates these patterns across scales. MRM adaptively integrates all representations across resolutions. This method achieves state-of-the-art performance across 8 time series analytical tasks, consistently surpassing both general-purpose and task-specific models. Our work marks a promising step toward the next generation of TSPMs, paving the way for further advancements in time series analysis.

Shiyu Wang, Jiawei Li, Xiaoming Shi, Zhou Ye, Baichuan Mo, Wenze Lin, Shengtong Ju, Zhixuan Chu, Ming Jin• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1
MSE0.419
601
Time Series ForecastingETTh2
MSE0.339
438
Time Series ForecastingETTm2
MSE0.269
382
Long-term time-series forecastingETTh1
MAE0.403
351
Long-term time-series forecastingWeather
MSE0.22
348
Multivariate ForecastingETTh2
MSE0.184
341
Long-term time-series forecastingETTh2
MSE0.276
327
Long-term time-series forecastingETTm2
MSE0.17
305
Long-term time-series forecastingETTm1
MSE0.31
295
Long-term time-series forecastingTraffic
MSE0.392
278
Showing 10 of 107 rows
...

Other info

Follow for update