DeepCAD: A Deep Generative Network for Computer-Aided Design Models
About
Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model for a drastically different shape representation --- describing a shape as a sequence of computer-aided design (CAD) operations. Unlike meshes and point clouds, CAD models encode the user creation process of 3D shapes, widely used in numerous industrial and engineering design tasks. However, the sequential and irregular structure of CAD operations poses significant challenges for existing 3D generative models. Drawing an analogy between CAD operations and natural language, we propose a CAD generative network based on the Transformer. We demonstrate the performance of our model for both shape autoencoding and random shape generation. To train our network, we create a new CAD dataset consisting of 178,238 models and their CAD construction sequences. We have made this dataset publicly available to promote future research on this topic.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Modality-to-CAD generation | DeepCAD variant datasets (test) | IoU46.7 | 18 | |
| text-to-CAD generation | DeepCAD Recap | Chamfer Distance (Mean)37.47 | 13 | |
| CAD reverse engineering | DeepCAD (test) | Med. CD9.64 | 10 | |
| CAD reverse engineering | Fusion360 (test) | Med. CD89.2 | 10 | |
| CAD command sequence generation | CAD command sequence generation dataset (test) | MMD31.91 | 8 | |
| CAD Generation | Recap-OmniCAD+ (test) | Intersection Ratio (IR)42.71 | 7 | |
| text-to-CAD generation | Recap-DeepCAD (test) | Intersection Ratio (IR)39.23 | 7 | |
| Single-image CAD reconstruction | DeepCAD | CD1.26 | 7 | |
| Unconditional CAD Generation | DeepCAD (test) | Coverage (COV)80.62 | 7 | |
| text-to-CAD generation | Recap-OmniCAD+ | Line F1 Score83.1 | 7 |