Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots

About

Automated warehouses execute millions of stow operations, where robots place objects into storage bins. For these systems it is valuable to anticipate how a bin will look from the current observations and the planned stow behavior before real execution. We propose FOREST, a stow-intent-conditioned world model that represents bin states as item-aligned instance masks and uses a latent diffusion transformer to predict the post-stow configuration from the observed context. Our evaluation shows that FOREST substantially improves the geometric agreement between predicted and true post-stow layouts compared with heuristic baselines. We further evaluate the predicted post-stow layouts in two downstream tasks, in which replacing the real post-stow masks with FOREST predictions causes only modest performance loss in load-quality assessment and multi-stow reasoning, indicating that our model can provide useful foresight signals for warehouse planning.

Lijun Zhang, Nikhil Chacko, Petter Nilsson, Ruinian Xu, Shantanu Thakar, Bai Lou, Harpreet Sawhney, Zhebin Zhang, Mudit Agrawal, Bhavana Chandrashekhar, Aaron Parness• 2026

Related benchmarks

TaskDatasetResultRank
Post-stow bin state predictionARMBench Direct Insert instance-mask space (test)
N-IoU70.21
4
Post-stow bin state predictionARMBench Bin Sweep instance-mask space (test)
N-IoU64.22
4
Showing 2 of 2 rows

Other info

Follow for update