MSG: Multi-Stream Generative Policies for Sample-Efficient Robotic Manipulation
About
Generative robot policies such as Flow Matching offer flexible, multi-modal policy learning but are sample-inefficient. Although object-centric policies improve sample efficiency, it does not resolve this limitation. In this work, we propose Multi-Stream Generative Policy (MSG), an inference-time composition framework that trains multiple object-centric policies and combines them at inference to improve generalization and sample efficiency. MSG is model-agnostic and inference-only, hence widely applicable to various generative policies and training paradigms. We perform extensive experiments both in simulation and on a real robot, demonstrating that our approach learns high-quality generative policies from as few as five demonstrations, resulting in a 95% reduction in demonstrations, and improves policy performance by 89 percent compared to single-stream approaches. Furthermore, we present comprehensive ablation studies on various composition strategies and provide practical recommendations for deployment. Finally, MSG enables zero-shot object instance transfer. We make our code publicly available at https://msg.cs.uni-freiburg.de.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| open drawer | Real-World (test) | Success Rate96 | 11 | |
| Robot Manipulation | RLBench 10 demonstrations (test) | Open Drawer Success Rate97 | 7 | |
| Pick-&-Place | Real-World (test) | Success Rate76 | 4 | |
| Pour Drink | Real-World (test) | Success Rate84 | 4 | |
| Store in Drawer | Real-World (test) | Success Rate68 | 4 | |
| Sweep Blocks | Real-World (test) | Success Rate88 | 4 |