Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Riemannian Score-Based Generative Modelling

About

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually add Gaussian noise to data, and a generative model, which entails a ``denoising'' process defined by approximating the time-reversal of the diffusion. Existing SGMs assume that data is supported on a Euclidean space, i.e. a manifold with flat geometry. In many domains such as robotics, geoscience or protein modelling, data is often naturally described by distributions living on Riemannian manifolds and current SGM techniques are not appropriate. We introduce here Riemannian Score-based Generative Models (RSGMs), a class of generative models extending SGMs to Riemannian manifolds. We demonstrate our approach on a variety of manifolds, and in particular with earth and climate science spherical data.

Valentin De Bortoli, Emile Mathieu, Michael Hutchinson, James Thornton, Yee Whye Teh, Arnaud Doucet• 2022

Related benchmarks

TaskDatasetResultRank
Density EstimationVolcano (test)
NLL-5.56
14
Spatio-temporal Density EstimationEarthquake (EQ) (test)
NLL-0.21
10
Density EstimationFloods (test)
NLL0.45
8
Density EstimationWildfires EOSDIS, 2020 (test)
NLL-1.33
8
Density EstimationEarthquakes NGDC/WDS, 2022a (test)
Negative Log-Likelihood-0.19
8
Generative ModelingEarthquake (test)
Test NLL-0.19
7
Generative ModelingFlood (test)
Test NLL0.48
7
Generative ModelingVolcano (test)
Test NLL-4.92
7
Generative ModelingFIRE (test)
Test NLL-1.33
7
Distribution GenerationVolcano
Negative Log-Likelihood (NLL)-5.56
6
Showing 10 of 19 rows

Other info

Follow for update