Learning Implicit Fields for Generative Shape Modeling
About
We advocate the use of implicit fields for learning generative models of shapes and introduce an implicit field decoder, called IM-NET, for shape generation, aimed at improving the visual quality of the generated shapes. An implicit field assigns a value to each point in 3D space, so that a shape can be extracted as an iso-surface. IM-NET is trained to perform this assignment by means of a binary classifier. Specifically, it takes a point coordinate, along with a feature vector encoding a shape, and outputs a value which indicates whether the point is outside the shape or not. By replacing conventional decoders by our implicit decoder for representation learning (via IM-AE) and shape generation (via IM-GAN), we demonstrate superior results for tasks such as generative shape modeling, interpolation, and single-view 3D reconstruction, particularly in terms of visual quality. Code and supplementary material are available at https://github.com/czq142857/implicit-decoder.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Object Reconstruction | ShapeNet (test) | Mean IoU0.659 | 80 | |
| 3D point cloud generation | ShapeNet Car (test) | 1-NNA (CD)88.92 | 57 | |
| 3D point cloud generation | ShapeNet Chair category (test) | MMD (CD)2.8935 | 56 | |
| 3D point cloud generation | ShapeNet Airplane category (test) | 1-NNA (CD, %)79.7 | 55 | |
| 3D human reconstruction | BUFF (test) | P2S Distance5.11 | 23 | |
| 3D Object Reconstruction | ShapeNet 32^3 resolution (test) | Parameters (M)55.45 | 20 | |
| 3D human reconstruction | RenderPeople (test) | Normal Error0.26 | 16 | |
| 3D human reconstruction | RenderPeople | Normal Error0.258 | 12 | |
| 3D human reconstruction | BUFF | P2S Distance5.11 | 11 | |
| 3D Object Reconstruction | Things3D | mIoU (chair)0.462 | 10 |