AccioScene: Compositional 3D Scene Generation via Graph Diffusion and Interaction-driven Critics
About
This paper presents a framework for generating 3D indoor scenes from text prompts. Existing methods often formulate scene synthesis as an object layout prediction problem conditioned on a single input modality, such as a text description, room shape, or scene graph. This design can lead to object collisions and limited functional plausibility, reducing its practical applicability. To address these limitations, we introduce a multi-stage pipeline that better reflects practical scene creation scenarios. Given a text prompt describing partial scene content, our method first uses graph diffusion to produce a contextually coherent scene graph and then predicts a realistic object layout. In addition, we incorporate lightweight human-object interaction priors to encourage human-centric and functional arrangements, with explicit spatial constraints to reduce interpenetration. Our approach generates coherent 3D scenes with viable layouts that better support human interaction. Experiments on the 3D-FRONT dataset demonstrate that our method achieves competitive or state-of-the-art performance compared with existing approaches, while improving the physical plausibility of generated scenes.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Text-to-scene generation | 3D-FRONT Livingroom (test) | FID105 | 15 | |
| Scene Rearrangement | 3D-FRONT Living room | FID105 | 13 | |
| Scene Rearrangement | 3D-FRONT Bedroom | FID101.4 | 13 | |
| Unconditional Scene Synthesis | 3D-FRONT Living room | FID115.1 | 10 | |
| Unconditional Scene Synthesis | 3D-FRONT Dining room | FID136.8 | 10 | |
| Unconditional Scene Synthesis | 3D-FRONT Bedroom | FID126 | 10 | |
| Scene Completion | 3D-FRONT Dining rooms | FID111.1 | 7 | |
| Indoor Scene Generation | 3D-FRONT Bedroom | Object Collision0.17 | 6 | |
| Indoor Scene Generation | 3D-FRONT Living room | Object Collision Rate19 | 6 | |
| Indoor Scene Generation | 3D-FRONT Dining room | Object Collision (Col_obj)0.18 | 6 |