Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception

About

Recent advances in robot imitation learning have yielded powerful visuomotor policies capable of manipulating a wide variety of objects directly from monocular visual inputs. However, monocular observations inherently lack reliable depth cues and spatial awareness, which are critical for precise manipulation in cluttered or geometrically complex scenes. To address this limitation, we introduce StereoPolicy, a new visuomotor policy learning framework that directly leverages synchronized stereo image pairs to strengthen geometric reasoning, without requiring explicit 3D reconstruction or camera calibration. StereoPolicy employs pretrained 2D vision encoders to process each image independently and fuses the resulting representations through a Stereo Transformer. This design implicitly captures spatial correspondence and disparity cues. The framework integrates seamlessly with diffusion-based and pretrained vision-language-action (VLA) policies, delivering consistent improvements over RGB, RGB-D, point cloud, and multi-view baselines across three simulation benchmarks: RoboMimic, RoboCasa, and OmniGibson. We further validate StereoPolicy on real-robot experiments spanning both tabletop and bimanual mobile manipulation settings. Our results underscore stereo vision as a scalable and robust modality that bridges 2D pretrained representations with 3D geometric understanding for robotic manipulation.

Evans Han, Yunfan Jiang, Yingke Wang, Haoyue Xiao, Huang Huang, Jianwen Xie, Jiajun Wu, Li Fei-Fei, Ruohan Zhang• 2026

Related benchmarks

TaskDatasetResultRank
ToolHangRoboMimic
Success Rate96
17
SquareRoboMimic
Success Rate100
14
TransportRoboMimic
Success Rate96
14
POURWATEROmniGibson
Success Rate70
12
STRAWBERRYOmniGibson
Success Rate100
12
TURNONRADIOOmniGibson
Success Rate82
12
OPENDOOROmniGibson
Success Rate100
12
Tabletop manipulationReal-World Tabletop
BANANA PNP Success Rate16
7
Showing 8 of 8 rows

Other info

Follow for update