Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learning

About

Machine learning based surrogate models offer researchers powerful tools for accelerating simulation-based workflows. However, as standard datasets in this space often cover small classes of physical behavior, it can be difficult to evaluate the efficacy of new approaches. To address this gap, we introduce the Well: a large-scale collection of datasets containing numerical simulations of a wide variety of spatiotemporal physical systems. The Well draws from domain experts and numerical software developers to provide 15TB of data across 16 datasets covering diverse domains such as biological systems, fluid dynamics, acoustic scattering, as well as magneto-hydrodynamic simulations of extra-galactic fluids or supernova explosions. These datasets can be used individually or as part of a broader benchmark suite. To facilitate usage of the Well, we provide a unified PyTorch interface for training and evaluating models. We demonstrate the function of this library by introducing example baselines that highlight the new challenges posed by the complex dynamics of the Well. The code and data is available at https://github.com/PolymathicAI/the_well.

Ruben Ohana, Michael McCabe, Lucas Meyer, Rudy Morel, Fruzsina J. Agocs, Miguel Beneitez, Marsha Berger, Blakesley Burkhart, Keaton Burns, Stuart B. Dalziel, Drummond B. Fielding, Daniel Fortunato, Jared A. Goldberg, Keiya Hirashima, Yan-Fei Jiang, Rich R. Kerswell, Suryanarayana Maddu, Jonah Miller, Payel Mukhopadhyay, Stefan S. Nixon, Jeff Shen, Romain Watteaux, Bruno R\'egaldo-Saint Blancard, Fran\c{c}ois Rozet, Liam H. Parker, Miles Cranmer, Shirley Ho• 2024

Related benchmarks

TaskDatasetResultRank
Next step predictionSupernova Explosion (test)
VRMSE0.3063
19
Next step predictionActive Matter (test)
VRMSE0.033
19
Next step predictionTurbulence Gravity Cooling (test)
VRMSE0.2096
19
Next step predictionTurbulent Radiative Layer 2D (test)
VRMSE0.2269
19
Next step predictionShear Flow (test)
VRMSE0.1049
19
Next step predictionRayleigh-Bénard (test)
VRMSE0.224
19
1:20 RolloutThe Well
Acoustic Scattering Maze Score0.0874
4
1:20 RolloutPDEBench
Diffusion-Reaction Error0.0279
4
1→1 next-step predictionThe Well acoustic_scattering (maze) (test)
VRMSE0.0126
4
1→1 next-step predictionThe Well active_matter (test)
VRMSE0.0918
4
Showing 10 of 20 rows

Other info

Code

Follow for update