Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments

About

Large Language Models (LLMs) have demonstrated remarkable capabilities in 3D indoor synthesis for Manhattan environments. However, existing methods often fail to capture plausible object layout patterns in non-Manhattan settings, primarily because they struggle to model non-orthogonal spatial relationships, leading to high geometric violations and low physical fidelity. To address this challenge, we propose SPG-Layout, a novel text-driven framework designed to generate physically plausible indoor scenes within complex non-Manhattan environments. Specifically, we first utilize statistical priors of object distributions to guide the training process, enhancing environmental understanding and fidelity. Furthermore, mirroring human design workflows, we adopt a hierarchical layout strategy that prioritizes the placement of large objects, thereby substantially minimizing layout violations. By synergizing these components, SPG-Layout achieves a balanced optimization of semantic realism and physical plausibility. To evaluate performance in these complex settings, we constructed a new benchmark comprising 500 diverse non-Manhattan environments. Extensive experiments demonstrate that SPG-Layout consistently and significantly outperforms existing methods across both Manhattan and non-Manhattan environments. The code will be publicly released.

Xianhui Meng, Zirui Song, Yuchen Zhang, Li Zhang, Yongxuan Lv, Xiuying Chen, Kun Wang, Yan Luo, Kai Chen, Hangjun Ye, Long Chen, Jun Liu, Xiaoshuai Hao• 2026

Related benchmarks

TaskDatasetResultRank
3D Indoor Scene Layout Generation3D Indoor Scene Layouts User Study
Votes1.36e+3
7
Full Scene SynthesisSSR-3DFRONT Bedroom
OOB29.3
7
Full Scene SynthesisSSR-3DFRONT Living Room
OOB4.05
7
Full Scene SynthesisSSR-3DFRONT All Categories
OOB14.93
7
Single Object AdditionSSR-3DFRONT Bedroom
OOB1.56
7
Single Object AdditionSSR-3DFRONT Living Room
OOB Error1.47
7
Single Object AdditionSSR-3DFRONT All Categories
OOB0.59
7
3D Indoor Scene SynthesisConventional Manhattan environments standard (test)
OOB8.12
7
Full Scene SynthesisFull Scene Synthesis non-Manhattan (all)
CNT82.33
4
Showing 9 of 9 rows

Other info

Follow for update