DeepCAD: A Deep Generative Network for Computer-Aided Design Models
About
Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model for a drastically different shape representation --- describing a shape as a sequence of computer-aided design (CAD) operations. Unlike meshes and point clouds, CAD models encode the user creation process of 3D shapes, widely used in numerous industrial and engineering design tasks. However, the sequential and irregular structure of CAD operations poses significant challenges for existing 3D generative models. Drawing an analogy between CAD operations and natural language, we propose a CAD generative network based on the Transformer. We demonstrate the performance of our model for both shape autoencoding and random shape generation. To train our network, we create a new CAD dataset consisting of 178,238 models and their CAD construction sequences. We have made this dataset publicly available to promote future research on this topic.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| CAD reverse engineering | DeepCAD (test) | Med. CD9.64 | 10 | |
| CAD reverse engineering | Fusion360 (test) | Med. CD89.2 | 10 | |
| CAD command sequence generation | CAD command sequence generation dataset (test) | MMD31.91 | 8 | |
| Single-image CAD reconstruction | DeepCAD | CD1.26 | 7 | |
| Unconditional CAD Generation | DeepCAD (test) | Coverage (COV)80.62 | 7 | |
| CAD command prediction | DeepCAD | Avg Command Accuracy57.1 | 6 | |
| Unconditional CAD Generation | DeepCAD #vertices>=12 (filtered) | COV75.44 | 4 | |
| CAD sequence recovery | DeepCAD 43 (test) | CD19.2 | 4 | |
| CAD sequence recovery | Fusion360 cross-dataset 41 (test) | Chamfer Distance (CD)104.2 | 4 | |
| Unconditional CAD Generation | DeepCAD (unfiltered) | Coverage (COV)65.46 | 4 |