Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Factorized Neural Operators Decompose Dynamic and Persistent Responses

About

Physical systems often exhibit heterogeneous mechanisms, where rapidly evolving dynamics coexist with persistent structures. Capturing such multiscale physical behavior remains challenging for existing neural operators, which typically rely on single dominant inductive bias and therefore couple distinct physical responses into a shared representation. We introduce the Unified Green's Function Framework across domains and propose the Factorized Neural Operators (FaNO), which decompose spectral representations into equivariant-inspired dynamic responses and invariant-inspired persistent responses, leading to better interpretability and generalization. Mechanistically, we show that the two operator branches spontaneously specialize into distinct physical roles that remain consistent across scales and domains: the equivariant-inspired branch captures rapidly varying transient dynamics, whereas the invariant-inspired branch extracts coherent persistent structures. This factorized mechanism of FaNO consistently improves prediction accuracy, parameter efficiency and cross-scale generalization across physical systems and domains. In particular, it maintains consistent predictions under long-horizon autoregressive rollout, cross-resolution extrapolation and physical-regime shifts. These findings suggest that scalable physical modeling may benefit from moving beyond single-inductive-bias formulations toward factorized operator representations that better reflect the heterogeneous organization of physical systems, accelerating the reliable deployment of machine learning for scientific computing and discovery.

Hao Tang, Yuechen Duan, Jiongyu Zhu, Zimeng Feng, Hao Li, Chao Li• 2026

Related benchmarks

TaskDatasetResultRank
Image ClassificationSpherical MNIST
Accuracy99.36
13
SWE predictionSWE (Shallow Water Equations) 64 x 128
MRE (1h)0.25
8
SWE predictionSWE (Shallow Water Equations) 128 x 256
MRE (1h)0.673
8
Weather forecastingWeatherBench 1 Day Forecast--
6
Image ClassificationSpherical MNIST 64x64 resolution (test)
Accuracy99.31
4
Operator learningHelmholtz benchmark (test)
Relative L2 Error2.272
4
Rollout PredictionNavier-Stokes 64x64, ν=10⁻⁵ (test)
Relative L2 Error (Step 1)90
4
SWE predictionSWE (Shallow Water Equations) 32 x 64
MRE (1h)0.263
4
SWE predictionSWE (Shallow Water Equations) 256 x 512
MRE (1h)2.409
4
Weather forecastingWeatherBench 32x64 1 Day Forecast
ACC (2T)96.6
4
Showing 10 of 24 rows

Other info

Follow for update