Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SAGE: Scalable Agentic 3D Scene Generation for Embodied AI

About

Real-world data collection for embodied agents remains costly and unsafe, calling for scalable, realistic, and simulator-ready 3D environments. However, existing scene-generation systems often rely on rule-based or task-specific pipelines, yielding artifacts and physically invalid scenes. We present SAGE, an agentic framework that, given a user-specified embodied task (e.g., "pick up a bowl and place it on the table"), understands the intent and automatically generates simulation-ready environments at scale. The agent couples multiple generators for layout and object composition with critics that evaluate semantic plausibility, visual realism, and physical stability. Through iterative reasoning and adaptive tool selection, it self-refines the scenes until meeting user intent and physical validity. The resulting environments are realistic, diverse, and directly deployable in modern simulators for policy training. Policies trained purely on this data exhibit clear scaling trends and generalize to unseen objects and layouts, demonstrating the promise of simulation-driven scaling for embodied AI. Code, demos, and the SAGE-10k dataset can be found on the project page here: https://research.nvidia.com/labs/dir/sage/.

Hongchi Xia, Xuan Li, Zhaoshuo Li, Qianli Ma, Jiashu Xu, Ming-Yu Liu, Yin Cui, Tsung-Yi Lin, Wei-Chiu Ma, Shenlong Wang, Shuran Song, Fangyin Wei• 2026

Related benchmarks

TaskDatasetResultRank
Robot ManipulationSceneWeaver Baseline 1 Generated Scenes (test)
Success Rate39.1
3
Robot ManipulationHolodeck Generated Scenes Baseline 2 (test)
Success Rate24.7
3
Robot ManipulationSAGE Generated Scenes (test)
Success Rate46
3
Scene GenerationCommon indoor scenes Bedroom
Object Count48.3
3
Scene GenerationCommon indoor scenes Kitchen
Object Count47.6
3
Scene GenerationCommon indoor scenes Living Room
Object Count48.8
3
Scene GenerationCommon indoor scenes Average
Object Count48.2
3
Showing 7 of 7 rows

Other info

Follow for update