Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FlowTS: Time Series Generation via Rectified Flow

About

Diffusion-based models have significant achievements in time series generation but suffer from inefficient computation: solving high-dimensional ODEs/SDEs via iterative numerical solvers demands hundreds to thousands of drift function evaluations per sample, incurring prohibitive costs. To resolve this, we propose FlowTS, an ODE-based model that leverages rectified flow with straight-line transport in probability space. By learning geodesic paths between distributions, FlowTS achieves computational efficiency through exact linear trajectory simulation, accelerating training and generation while improving performances. We further introduce an adaptive sampling strategy inspired by the exploration-exploitation trade-off, balancing noise adaptation and precision. Notably, FlowTS enables seamless adaptation from unconditional to conditional generation without retraining, ensuring efficient real-world deployment. Also, to enhance generation authenticity, FlowTS integrates trend and seasonality decomposition, attention registers (for global context aggregation), and Rotary Position Embedding (RoPE) (for position information). For unconditional setting, extensive experiments demonstrate that FlowTS achieves state-of-the-art performance, with context FID scores of 0.019 and 0.011 on Stock and ETTh datasets (prev. best: 0.067, 0.061). For conditional setting, we have achieved superior performance in solar forecasting (MSE 213, prev. best: 375) and MuJoCo imputation tasks (MSE 7e-5, prev. best 2.7e-4). The code is available at https://github.com/UNITES-Lab/FlowTS.

Yang Hu, Xiao Wang, Zezhen Ding, Lirong Wu, Huatian Zhang, Stan Z. Li, Sheng Wang, Jiheng Zhang, Ziyun Li, Tianlong Chen• 2024

Related benchmarks

TaskDatasetResultRank
Time-series generationETTh
Predictive Score0.115
69
Generative ModelingIEEE 14-bus AC 68-dim (test)
W1 Distance0.0229
20
Time Series Super-ResolutionETTm1, Weather, and PEMS-SF
Generation Time0.04
10
Unconditional Time Series GenerationSines L=24 (test)
Discriminative Score (DS)0.005
10
Time Series Super-ResolutionETTm1, Weather, and PEMS-SF (test)
GFLOPs3.74
10
Sampled Super-ResolutionSCP1 (test)
MSE1.897
10
Aggregated Super-ResolutionETTh2
MSE10.422
10
Sampled Super-ResolutionETTm1 (test)
MSE3.661
10
Sampled Super-ResolutionETTm2 (test)
MSE1.68
10
Aggregated Super-ResolutionETTm2
MSE1.742
10
Showing 10 of 32 rows

Other info

Follow for update