Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DVD: Discrete Voxel Diffusion for 3D Generation and Editing

About

We introduce Discrete Voxel Diffusion (DVD), a discrete diffusion framework to generate, assess, and edit sparse voxels for SLat (Structured LATent) based 3D generative pipelines. Although discrete diffusion has not generally displaced continuous diffusion in image-like generation, we show that it can be an effective first-stage prior for sparse voxel scaffolds. By treating voxel occupancy as a native discrete variable, DVD avoids continuous-to-discrete thresholding and provides a simple framework for voxel generation, uncertainty estimation, and editing. Beyond quality gains, DVD provides more interpretable generation dynamics through explicit categorical modeling. Furthermore, we leverage the predictive entropy as a robust uncertainty metric to identify ambiguous voxel regions and complicated samples, facilitating tasks such as data filtering and quality assessment. Finally, we propose a lightweight fine-tuning strategy using block-structured perturbation patterns. This approach empowers the model to inpaint and edit voxels within a single sampling round, requiring negligible auxiliary computation and no additional model evaluations.

Zhengrui Xiang, Jiaqi Wu, Fupeng Sun, Heliang Zheng, Yingzhen Li• 2026

Related benchmarks

TaskDatasetResultRank
Image-to-3DTraining subset
FID (PC variant)2.43
4
Text-to-3D(train)
CLIP Similarity25.54
2
Text-to-3DToys4k
CLIP Score26.05
2
Showing 3 of 3 rows

Other info

Follow for update