Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising

About

Understanding and generating 3D objects as compositions of meaningful parts is fundamental to human perception and reasoning. However, most text-to-3D methods overlook the semantic and functional structure of parts. While recent part-aware approaches introduce decomposition, they remain largely geometry-focused, lacking semantic grounding and failing to model how parts align with textual descriptions or their inter-part relations. We propose DreamPartGen, a framework for semantically grounded, part-aware text-to-3D generation. DreamPartGen introduces Duplex Part Latents (DPLs) that jointly model each part's geometry and appearance, and Relational Semantic Latents (RSLs) that capture inter-part dependencies derived from language. A synchronized co-denoising process enforces mutual geometric and semantic consistency, enabling coherent, interpretable, and text-aligned 3D synthesis. Across multiple benchmarks, DreamPartGen delivers state-of-the-art performance in geometric fidelity and text-shape alignment.

Tianjiao Yu, Xinzhuo Li, Muntasir Wahed, Jerry Xiong, Yifan Shen, Ying Shen, Ismini Lourentzou• 2026

Related benchmarks

TaskDatasetResultRank
3D Mesh GenerationObjaverse
Chamfer Distance0.141
18
3D Object GenerationShapeNet
Chamfer Distance (CD)0.222
10
Part-level 3D GenerationShapeNet
Chamfer Distance (CD)0.088
7
3D Scene Generation3D-FRONT Occluded 1.0
Chamfer Distance0.2321
6
3D Object GenerationABO
CD0.101
5
3D Object GenerationPartRel3D
Chamfer Distance (CD)0.081
5
Part-level 3D object generationObjaverse
r-FID4.0579
5
Part-level 3D object generationShapeNet
r-FID4.9736
5
Part-level 3D object generationABO
r-FID4.5632
5
Part-level 3D object generationPartRel3D
r-FID9.7836
5
Showing 10 of 14 rows

Other info

Follow for update