Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Learning Gradient Fields for Shape Generation

About

In this work, we propose a novel technique to generate shapes from point cloud data. A point cloud can be viewed as samples from a distribution of 3D points whose density is concentrated near the surface of the shape. Point cloud generation thus amounts to moving randomly sampled points to high-density areas. We generate point clouds by performing stochastic gradient ascent on an unnormalized probability density, thereby moving sampled points toward the high-likelihood regions. Our model directly predicts the gradient of the log density field and can be trained with a simple objective adapted from score-based generative models. We show that our method can reach state-of-the-art performance for point cloud auto-encoding and generation, while also allowing for extraction of a high-quality implicit surface. Code is available at https://github.com/RuojinCai/ShapeGF.

Ruojin Cai, Guandao Yang, Hadar Averbuch-Elor, Zekun Hao, Serge Belongie, Noah Snavely, Bharath Hariharan• 2020

Related benchmarks

TaskDatasetResultRank
Point Cloud ClassificationModelNet40 (test)
Accuracy84.6
224
Point Cloud ClassificationModelNet10 (test)
Accuracy90.2
71
3D point cloud generationShapeNet Car (test)
1-NNA (CD)58
57
3D point cloud generationShapeNet Chair category (test)
MMD (CD)3.7243
56
3D point cloud generationShapeNet Airplane category (test)
1-NNA (CD, %)61.94
55
Point cloud generationShapeNet Car
1-NNA (CD)63.2
27
Point cloud generationShapeNet chair
1-NNA (CD)68.96
23
Point cloud generationShapeNet Chair (test)
1-NNA (CD)61.8
16
Point cloud generationShapeNetPart Car (test)
1-NNA (CD)58
13
3D Shape GenerationShapeNet Airplane PointFlow (test)
1-NNA (CD)81.23
13
Showing 10 of 25 rows

Other info

Follow for update