Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Revisiting VAE for Unsupervised Time Series Anomaly Detection: A Frequency Perspective

About

Time series Anomaly Detection (AD) plays a crucial role for web systems. Various web systems rely on time series data to monitor and identify anomalies in real time, as well as to initiate diagnosis and remediation procedures. Variational Autoencoders (VAEs) have gained popularity in recent decades due to their superior de-noising capabilities, which are useful for anomaly detection. However, our study reveals that VAE-based methods face challenges in capturing long-periodic heterogeneous patterns and detailed short-periodic trends simultaneously. To address these challenges, we propose Frequency-enhanced Conditional Variational Autoencoder (FCVAE), a novel unsupervised AD method for univariate time series. To ensure an accurate AD, FCVAE exploits an innovative approach to concurrently integrate both the global and local frequency features into the condition of Conditional Variational Autoencoder (CVAE) to significantly increase the accuracy of reconstructing the normal data. Together with a carefully designed "target attention" mechanism, our approach allows the model to pick the most useful information from the frequency domain for better short-periodic trend construction. Our FCVAE has been evaluated on public datasets and a large-scale cloud system, and the results demonstrate that it outperforms state-of-the-art methods. This confirms the practical applicability of our approach in addressing the limitations of current VAE-based anomaly detection models.

Zexin Wang, Changhua Pei, Minghua Ma, Xin Wang, Zhihan Li, Dan Pei, Saravan Rajmohan, Dongmei Zhang, Qingwei Lin, Haiming Zhang, Jianhui Li, Gaogang Xie• 2024

Related benchmarks

TaskDatasetResultRank
Anomaly DetectionWSD (test)
F1 Score0.859
23
Univariate Time Series Anomaly DetectionCIMIS44AirTemperature UCR Archive (test)
F1 Score85
22
Univariate Time Series Anomaly DetectionECG UCR Archive (test)
F1 Score91.4
22
Anomaly DetectionYahoo (test)
F1 Score85.4
17
Anomaly DetectionNAB (test)
F1 Score97.2
17
Inference EfficiencyInference Efficiency Evaluation
Inference Latency (s)0.0077
12
Anomaly DetectionKPI (test)
F1 Score91.5
6
Univariate Anomaly DetectionIT monitoring datasets
CPU Time (s)22
5
Showing 8 of 8 rows

Other info

Follow for update