Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Riemannian Score-Based Generative Modelling

About

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually add Gaussian noise to data, and a generative model, which entails a ``denoising'' process defined by approximating the time-reversal of the diffusion. Existing SGMs assume that data is supported on a Euclidean space, i.e. a manifold with flat geometry. In many domains such as robotics, geoscience or protein modelling, data is often naturally described by distributions living on Riemannian manifolds and current SGM techniques are not appropriate. We introduce here Riemannian Score-based Generative Models (RSGMs), a class of generative models extending SGMs to Riemannian manifolds. We demonstrate our approach on a variety of manifolds, and in particular with earth and climate science spherical data.

Valentin De Bortoli, Emile Mathieu, Michael Hutchinson, James Thornton, Yee Whye Teh, Arnaud Doucet• 2022

Related benchmarks

TaskDatasetResultRank
Density EstimationVolcano (test)
NLL-5.56
14
Spatio-temporal Density EstimationEarthquake (EQ) (test)
NLL-0.21
10
Density EstimationFloods (test)
NLL0.45
8
Density EstimationWildfires EOSDIS, 2020 (test)
NLL-1.33
8
Density EstimationEarthquakes NGDC/WDS, 2022a (test)
Negative Log-Likelihood-0.19
8
Distribution GenerationVolcano
Negative Log-Likelihood (NLL)-5.56
6
Distribution GenerationFIRE
NLL-1.24
6
Density EstimationFlood (test)
NLL0.52
6
Density EstimationFIRE (test)
NLL-1.24
6
Distribution GenerationEarthquake
NLL-0.21
6
Showing 10 of 15 rows

Other info

Follow for update