Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MG-TSD: Multi-Granularity Time Series Diffusion Models with Guided Learning Process

About

Recently, diffusion probabilistic models have attracted attention in generative time series forecasting due to their remarkable capacity to generate high-fidelity samples. However, the effective utilization of their strong modeling ability in the probabilistic time series forecasting task remains an open question, partially due to the challenge of instability arising from their stochastic nature. To address this challenge, we introduce a novel Multi-Granularity Time Series Diffusion (MG-TSD) model, which achieves state-of-the-art predictive performance by leveraging the inherent granularity levels within the data as given targets at intermediate diffusion steps to guide the learning process of diffusion models. The way to construct the targets is motivated by the observation that the forward process of the diffusion model, which sequentially corrupts the data distribution to a standard normal distribution, intuitively aligns with the process of smoothing fine-grained data into a coarse-grained representation, both of which result in a gradual loss of fine distribution features. In the study, we derive a novel multi-granularity guidance diffusion loss function and propose a concise implementation method to effectively utilize coarse-grained data across various granularity levels. More importantly, our approach does not rely on additional external data, making it versatile and applicable across various domains. Extensive experiments conducted on real-world datasets demonstrate that our MG-TSD model outperforms existing time series prediction methods.

Xinyao Fan, Yueying Wu, Chang Xu, Yuhao Huang, Weiqing Liu, Jiang Bian• 2024

Related benchmarks

TaskDatasetResultRank
ForecastingKDDCUP
CRPS0.2902
22
Multivariate probabilistic forecastingsolar
CRPS-sum0.3239
12
Time Series ForecastingTraffic
NRMSE Sum0.0653
10
Time Series ForecastingKDD-cup
NRMSE (sum)0.2605
10
Time Series Forecastingsolar
NRMSE Sum0.6953
10
Time Series ForecastingElectricity
NRMSE Sum3.48
10
Time Series Forecastingtaxi
NRMSE Sum0.2365
10
Multivariate probabilistic forecastingTraffic
CRPS Sum0.0414
9
Multivariate probabilistic forecastingElectricity
CRPS Sum0.0232
9
Probabilistic Forecastingtaxi
CRPS0.1255
9
Showing 10 of 12 rows

Other info

Follow for update