Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MTSCI: A Conditional Diffusion Model for Multivariate Time Series Consistent Imputation

About

Missing values are prevalent in multivariate time series, compromising the integrity of analyses and degrading the performance of downstream tasks. Consequently, research has focused on multivariate time series imputation, aiming to accurately impute the missing values based on available observations. A key research question is how to ensure imputation consistency, i.e., intra-consistency between observed and imputed values, and inter-consistency between adjacent windows after imputation. However, previous methods rely solely on the inductive bias of the imputation targets to guide the learning process, ignoring imputation consistency and ultimately resulting in poor performance. Diffusion models, known for their powerful generative abilities, prefer to generate consistent results based on available observations. Therefore, we propose a conditional diffusion model for Multivariate Time Series Consistent Imputation (MTSCI). Specifically, MTSCI employs a contrastive complementary mask to generate dual views during the forward noising process. Then, the intra contrastive loss is calculated to ensure intra-consistency between the imputed and observed values. Meanwhile, MTSCI utilizes a mixup mechanism to incorporate conditional information from adjacent windows during the denoising process, facilitating the inter-consistency between imputed samples. Extensive experiments on multiple real-world datasets demonstrate that our method achieves the state-of-the-art performance on multivariate time series imputation task under different missing scenarios. Code is available at https://github.com/JeremyChou28/MTSCI.

Jianping Zhou, Junhao Li, Guanjie Zheng, Xinbing Wang, Chenghu Zhou• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ImputationWeather
MAE5.574
120
Time Series ImputationETT
MAE0.248
44
Time Series ImputationYeast
MAE7.392
36
Time Series ImputationWeather
CRPS0.018
32
Time Series ImputationWeather
RMSE91.81
32
Time Series ImputationETT
CRPS0.04
32
Time Series ImputationYeast
RMSE37.946
24
Time Series ImputationYeast
CRPS0.015
24
Time Series ImputationWeather Point-wise missing
MAPE47.52
16
Time Series ImputationETT Point-wise missing
MAPE3.138
16
Showing 10 of 14 rows

Other info

Follow for update