Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FlowTS: Time Series Generation via Rectified Flow

About

Diffusion-based models have significant achievements in time series generation but suffer from inefficient computation: solving high-dimensional ODEs/SDEs via iterative numerical solvers demands hundreds to thousands of drift function evaluations per sample, incurring prohibitive costs. To resolve this, we propose FlowTS, an ODE-based model that leverages rectified flow with straight-line transport in probability space. By learning geodesic paths between distributions, FlowTS achieves computational efficiency through exact linear trajectory simulation, accelerating training and generation while improving performances. We further introduce an adaptive sampling strategy inspired by the exploration-exploitation trade-off, balancing noise adaptation and precision. Notably, FlowTS enables seamless adaptation from unconditional to conditional generation without retraining, ensuring efficient real-world deployment. Also, to enhance generation authenticity, FlowTS integrates trend and seasonality decomposition, attention registers (for global context aggregation), and Rotary Position Embedding (RoPE) (for position information). For unconditional setting, extensive experiments demonstrate that FlowTS achieves state-of-the-art performance, with context FID scores of 0.019 and 0.011 on Stock and ETTh datasets (prev. best: 0.067, 0.061). For conditional setting, we have achieved superior performance in solar forecasting (MSE 213, prev. best: 375) and MuJoCo imputation tasks (MSE 7e-5, prev. best 2.7e-4). The code is available at https://github.com/UNITES-Lab/FlowTS.

Yang Hu, Xiao Wang, Zezhen Ding, Lirong Wu, Huatian Zhang, Stan Z. Li, Sheng Wang, Jiheng Zhang, Ziyun Li, Tianlong Chen• 2024

Related benchmarks

TaskDatasetResultRank
Time-series generationETTh
Predictive Score0.115
69
Generative ModelingIEEE 14-bus AC 68-dim (test)
W1 Distance0.0229
20
Unconditional Time Series GenerationSines L=24 (test)
Discriminative Score (DS)0.005
10
Unconditional Time Series GenerationStocks L=24 (test)
Discrimination Score (DS)0.019
10
Unconditional Time Series GenerationETTh L=24 (test)
Discriminative Score (DS)0.011
10
Unconditional Time Series GenerationEnergy L=24 (test)
Discriminative Score (DS)0.053
10
Showing 6 of 6 rows

Other info

Follow for update