Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Flow Matching on General Geometries

About

We propose Riemannian Flow Matching (RFM), a simple yet powerful framework for training continuous normalizing flows on manifolds. Existing methods for generative modeling on manifolds either require expensive simulation, are inherently unable to scale to high dimensions, or use approximations for limiting quantities that result in biased training objectives. Riemannian Flow Matching bypasses these limitations and offers several advantages over previous approaches: it is simulation-free on simple geometries, does not require divergence computation, and computes its target vector field in closed-form. The key ingredient behind RFM is the construction of a relatively simple premetric for defining target vector fields, which encompasses the existing Euclidean case. To extend to general geometries, we rely on the use of spectral decompositions to efficiently compute premetrics on the fly. Our method achieves state-of-the-art performance on many real-world non-Euclidean datasets, and we demonstrate tractable training on general geometries, including triangular meshes with highly non-trivial curvature and boundaries.

Ricky T. Q. Chen, Yaron Lipman• 2023

Related benchmarks

TaskDatasetResultRank
3D Human Pose and Shape Estimation3DPW (test)
MPJPE-PA71.53
158
Density EstimationVolcano (test)
NLL-7.93
14
IK SolverAMASS (test)
FID0.976
12
Generative ModelingSpot the Cow (test)
NLL0.95
10
Generative ModelingStanford Bunny (test)
NLL1.48
10
Pose DenoisingAMASS (test)
Delta Q + m2m0.216
10
Density EstimationFloods (test)
NLL0.42
8
Density EstimationWildfires EOSDIS, 2020 (test)
NLL-1.86
8
Density EstimationEarthquakes NGDC/WDS, 2022a (test)
Negative Log-Likelihood-0.28
8
Pose GenerationAMASS (test)
FID0.346
8
Showing 10 of 21 rows

Other info

Follow for update