UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD
About
Computer-Aided Design (CAD) underpins modern engineering and manufacturing by enabling the creation of precise, editable 3D models. However, CAD research typically studies tasks in isolation, and multi-modal, multi-task learning for CAD is hindered by the absence of a unified benchmark. To address this gap, we introduce UniCAD, a comprehensive benchmark for multi-modal CAD learning that covers point-to-CAD reconstruction, text/image-to-CAD generation, and CAD question answering across diverse input modalities. Alongside the benchmark, we present UniCAD-MLLM, a universal multi-modal large language model that ingests text, images, sketches, and point clouds and performs these heterogeneous tasks in an end-to-end fashion within a single framework. Extensive experiments on the UniCAD and Fusion360 benchmarks demonstrate that UniCAD-MLLM achieves state-of-the-art performance across all tasks, outperforming existing task-specific and multi-task baselines. We will release the dataset, code, and pretrained models to accelerate future research.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| CAD reconstruction from point clouds | Fusion360 (test) | Chamfer Distance0.18 | 15 | |
| Point Cloud Reconstruction | UniCAD (test) | CD0.17 | 11 | |
| CAD reconstruction from multi-view images | Fusion360 (test) | Chamfer Distance (CD)0.16 | 8 | |
| Single-view CAD reconstruction | UniCAD (test) | Chamfer Distance (CD)0.17 | 8 | |
| Multi-view Image CAD Reconstruction | UniCAD (test) | Chamfer Distance (CD)0.17 | 5 | |
| Text-driven CAD Reconstruction | UniCAD (test) | Chamfer Distance (CD)0.2 | 4 | |
| CAD Question Answering | UniCAD (test) | Accuracy90 | 3 | |
| Multi-view Sketch CAD Reconstruction | UniCAD (test) | Chamfer Distance (CD)0.22 | 1 |