FourierFlow: Frequency-aware Flow Matching for Generative Turbulence Modeling
About
Modeling complex fluid systems, especially turbulence governed by partial differential equations (PDEs), remains a fundamental challenge in science and engineering. Recently, diffusion-based generative models have gained attention as a powerful approach for these tasks, owing to their capacity to capture long-range dependencies and recover hierarchical structures. However, we present both empirical and theoretical evidence showing that generative models struggle with significant spectral bias and common-mode noise when generating high-fidelity turbulent flows. Here we propose FourierFlow, a novel generative turbulence modeling framework that enhances the frequency-aware learning by both implicitly and explicitly mitigating spectral bias and common-mode noise. FourierFlow comprises three key innovations. Firstly, we adopt a dual-branch backbone architecture, consisting of a salient flow attention branch with local-global awareness to focus on sensitive turbulence areas. Secondly, we introduce a frequency-guided Fourier mixing branch, which is integrated via an adaptive fusion strategy to explicitly mitigate spectral bias in the generative model. Thirdly, we leverage the high-frequency modeling capabilities of the masked auto-encoder pre-training and implicitly align the features of the generative model toward high-frequency components. We validate the effectiveness of FourierFlow on three canonical turbulent flow scenarios, demonstrating superior performance compared to state-of-the-art methods. Furthermore, we show that our model exhibits strong generalization capabilities in challenging settings such as out-of-distribution domains, long-term temporal extrapolation, and robustness to noisy inputs. The code can be found at https://github.com/AI4Science-WestlakeU/FourierFlow.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| PDE System Rollout Forecasting | Rayleigh-Bénard | VRMSE (Rollout 01:32)1.106 | 14 | |
| PDE System Rollout Forecasting | Active Matter | VRMSE (01:16)1.302 | 14 | |
| PDE System Rollout Forecasting | Turbulent Radiative Layer 2D | VRMSE (Rollouts 01-32)0.602 | 13 | |
| Autoregressive rollout | Active Matter | CRPS (1:16)0.185 | 11 | |
| Autoregressive rollout | Turbulent Radiative Layer 2D | CRPS (Rollout 01:32)0.854 | 11 | |
| Autoregressive rollout | Rayleigh-Bénard | CRPS (Rollout 01:32)0.009 | 11 | |
| PDE Emulation | TRL t_cool=0.03 | CRPS1.39 | 11 | |
| PDE Emulation | TRL t_cool=0.06 | CRPS1.411 | 11 | |
| PDE Emulation | TRL t_cool=0.10 | CRPS1.175 | 11 | |
| PDE Emulation | Rayleigh-Bénard | CRPS (Ra=10^6)0.071 | 11 |