Riemannian Score-Based Generative Modelling
About
Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually add Gaussian noise to data, and a generative model, which entails a ``denoising'' process defined by approximating the time-reversal of the diffusion. Existing SGMs assume that data is supported on a Euclidean space, i.e. a manifold with flat geometry. In many domains such as robotics, geoscience or protein modelling, data is often naturally described by distributions living on Riemannian manifolds and current SGM techniques are not appropriate. We introduce here Riemannian Score-based Generative Models (RSGMs), a class of generative models extending SGMs to Riemannian manifolds. We demonstrate our approach on a variety of manifolds, and in particular with earth and climate science spherical data.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Density Estimation | Volcano (test) | NLL-5.56 | 14 | |
| Spatio-temporal Density Estimation | Earthquake (EQ) (test) | NLL-0.21 | 10 | |
| Density Estimation | Floods (test) | NLL0.45 | 8 | |
| Density Estimation | Wildfires EOSDIS, 2020 (test) | NLL-1.33 | 8 | |
| Density Estimation | Earthquakes NGDC/WDS, 2022a (test) | Negative Log-Likelihood-0.19 | 8 | |
| Distribution Generation | Volcano | Negative Log-Likelihood (NLL)-5.56 | 6 | |
| Distribution Generation | FIRE | NLL-1.24 | 6 | |
| Density Estimation | Flood (test) | NLL0.52 | 6 | |
| Density Estimation | FIRE (test) | NLL-1.24 | 6 | |
| Distribution Generation | Earthquake | NLL-0.21 | 6 |