Multiresolution Deep Implicit Functions for 3D Shape Representation
About
We introduce Multiresolution Deep Implicit Functions (MDIF), a hierarchical representation that can recover fine geometry detail, while being able to perform global operations such as shape completion. Our model represents a complex 3D shape with a hierarchy of latent grids, which can be decoded into different levels of detail and also achieve better accuracy. For shape completion, we propose latent grid dropout to simulate partial data in the latent space and therefore defer the completing functionality to the decoder side. This along with our multires design significantly improves the shape completion quality under decoder-only latent optimization. To the best of our knowledge, MDIF is the first deep implicit function model that can at the same time (1) represent different levels of detail and allow progressive decoding; (2) support both encoder-decoder inference and decoder-only latent optimization, and fulfill multiple applications; (3) perform detailed decoder-only shape completion. Experiments demonstrate its superior performance against prior art in various 3D reconstruction tasks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Shape Reconstruction | ShapeNet table | Chamfer Distance0.046 | 9 | |
| 3D Shape Reconstruction | ShapeNet cabinet | Chamfer Distance0.051 | 6 | |
| 3D Shape Reconstruction | ShapeNet Car | Chamfer Distance0.088 | 6 | |
| 3D Shape Reconstruction | ShapeNet chair | Chamfer Distance0.035 | 6 | |
| 3D Shape Reconstruction | ShapeNet (display) | Chamfer Distance0.019 | 6 | |
| 3D Shape Reconstruction | ShapeNet (speaker) | Chamfer Distance0.044 | 6 | |
| 3D Shape Reconstruction | ShapeNet telephone | Chamfer Distance0.01 | 6 | |
| 3D Shape Reconstruction | ShapeNet airplane | Chamfer Distance0.028 | 6 | |
| 3D Shape Reconstruction | ShapeNet (bench) | Chamfer Distance0.052 | 6 | |
| 3D Shape Reconstruction | ShapeNet lamp | Chamfer Distance0.795 | 6 |