Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domains
About
The very challenging task of learning solution operators of PDEs on arbitrary domains accurately and efficiently is of vital importance to engineering and industrial simulations. Despite the existence of many operator learning algorithms to approximate such PDEs, we find that accurate models are not necessarily computationally efficient and vice versa. We address this issue by proposing a geometry aware operator transformer (GAOT) for learning PDEs on arbitrary domains. GAOT combines novel multiscale attentional graph neural operator encoders and decoders, together with geometry embeddings and (vision) transformer processors to accurately map information about the domain and the inputs into a robust approximation of the PDE solution. Multiple innovations in the implementation of GAOT also ensure computational efficiency and scalability. We demonstrate this significant gain in both accuracy and efficiency of GAOT over several baselines on a large number of learning tasks from a diverse set of PDEs, including achieving state of the art performance on three large scale three-dimensional industrial CFD datasets.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Generative Modeling | Gaussian Blobs | MMD0.214 | 10 | |
| Time-dependent PDE Solving | NS-SL | Median Relative L1 Error1.21 | 8 | |
| Time-dependent PDE Solving | CE-Gauss | Median Relative L1 Error6.4 | 8 | |
| Time-dependent PDE Solving | Wave-Layer | Median Relative L1 Error5.78 | 8 | |
| Neural Operator Learning | POISSON C-SINES | Median Relative L1 Error3.1 | 8 | |
| Neural Operator Learning | POISSON GAUSS | Median Relative L1 Error0.83 | 8 | |
| Neural Operator Learning | Elasticity | Median Relative L1 Error1.34 | 8 | |
| Neural Operator Learning | NACA2412 | Median Relative L1 Error6.66 | 8 | |
| Time-dependent PDE Solving | NS-PwC | Median Relative L1 Error1.5 | 8 | |
| Time-dependent PDE Solving | NS-SVS | Median Relative L1 Error0.46 | 8 |