Learning Gradient Fields for Shape Generation
About
In this work, we propose a novel technique to generate shapes from point cloud data. A point cloud can be viewed as samples from a distribution of 3D points whose density is concentrated near the surface of the shape. Point cloud generation thus amounts to moving randomly sampled points to high-density areas. We generate point clouds by performing stochastic gradient ascent on an unnormalized probability density, thereby moving sampled points toward the high-likelihood regions. Our model directly predicts the gradient of the log density field and can be trained with a simple objective adapted from score-based generative models. We show that our method can reach state-of-the-art performance for point cloud auto-encoding and generation, while also allowing for extraction of a high-quality implicit surface. Code is available at https://github.com/RuojinCai/ShapeGF.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Point Cloud Classification | ModelNet40 (test) | Accuracy84.6 | 224 | |
| Point Cloud Classification | ModelNet10 (test) | Accuracy90.2 | 71 | |
| 3D point cloud generation | ShapeNet Car (test) | 1-NNA (CD)58 | 57 | |
| 3D point cloud generation | ShapeNet Chair category (test) | MMD (CD)3.7243 | 56 | |
| 3D point cloud generation | ShapeNet Airplane category (test) | 1-NNA (CD, %)61.94 | 55 | |
| Point cloud generation | ShapeNet Car | 1-NNA (CD)63.2 | 27 | |
| Point cloud generation | ShapeNet chair | 1-NNA (CD)68.96 | 23 | |
| Point cloud generation | ShapeNet Chair (test) | 1-NNA (CD)61.8 | 16 | |
| Point cloud generation | ShapeNetPart Car (test) | 1-NNA (CD)58 | 13 | |
| 3D Shape Generation | ShapeNet Airplane PointFlow (test) | 1-NNA (CD)81.23 | 13 |