Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AccioScene: Compositional 3D Scene Generation via Graph Diffusion and Interaction-driven Critics

About

This paper presents a framework for generating 3D indoor scenes from text prompts. Existing methods often formulate scene synthesis as an object layout prediction problem conditioned on a single input modality, such as a text description, room shape, or scene graph. This design can lead to object collisions and limited functional plausibility, reducing its practical applicability. To address these limitations, we introduce a multi-stage pipeline that better reflects practical scene creation scenarios. Given a text prompt describing partial scene content, our method first uses graph diffusion to produce a contextually coherent scene graph and then predicts a realistic object layout. In addition, we incorporate lightweight human-object interaction priors to encourage human-centric and functional arrangements, with explicit spatial constraints to reduce interpenetration. Our approach generates coherent 3D scenes with viable layouts that better support human interaction. Experiments on the 3D-FRONT dataset demonstrate that our method achieves competitive or state-of-the-art performance compared with existing approaches, while improving the physical plausibility of generated scenes.

Yao Wei, Matteo Toso, Pietro Morerio, Changjae Oh, Michael Ying Yang, Alessio Del Bue• 2025

Related benchmarks

TaskDatasetResultRank
Text-to-scene generation3D-FRONT Livingroom (test)
FID105
15
Scene Rearrangement3D-FRONT Living room
FID105
13
Scene Rearrangement3D-FRONT Bedroom
FID101.4
13
Unconditional Scene Synthesis3D-FRONT Living room
FID115.1
10
Unconditional Scene Synthesis3D-FRONT Dining room
FID136.8
10
Unconditional Scene Synthesis3D-FRONT Bedroom
FID126
10
Scene Completion3D-FRONT Dining rooms
FID111.1
7
Indoor Scene Generation3D-FRONT Bedroom
Object Collision0.17
6
Indoor Scene Generation3D-FRONT Living room
Object Collision Rate19
6
Indoor Scene Generation3D-FRONT Dining room
Object Collision (Col_obj)0.18
6
Showing 10 of 18 rows

Other info

Follow for update