CLASH: Collision Learning via Augmented Sim-to-real Hybridization to Bridge the Reality Gap
About
The sim-to-real gap, particularly in the inaccurate modeling of contact-rich dynamics like collisions, remains a primary obstacle to deploying robot policies trained in simulation. Conventional physics engines often trade accuracy for computational speed, leading to discrepancies that prevent direct policy transfer. To address this, we introduce Collision Learning via Augmented Sim-to-real Hybridization (CLASH), a data-efficient framework that creates a high-fidelity hybrid simulator by learning a surrogate collision model from a minimal set of real-world data. In CLASH, a base model is first distilled from an imperfect simulator (MuJoCo) to capture general physical priors; this model is then fine-tuned with a remarkably small number of real-world interactions (as few as 10 samples) to correct for the simulator's inherent inaccuracies. The resulting hybrid simulator not only achieves higher predictive accuracy but also reduces collision computation time by nearly 50\%. We demonstrate that policies obtained with our hybrid simulator transfer more robustly to the real world, doubling the success rate in sequential pushing tasks with reinforecement learning and significantly increase the task performance with model-based control.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Collision Prediction | Semi-Cylinder Shape Block Real-world alpha=0.1 (test) | Accuracy (alpha=0.1)76 | 3 | |
| Collision Prediction | Square Shape Block Real-world alpha=0.1 (test) | Accuracy (alpha=0.1)55 | 3 | |
| Collision Prediction | Triangle Shape Block Real-world alpha=0.1 (test) | Accuracy (alpha=0.1)54 | 3 | |
| Model-Based Optimization | Semi-Cylinder | Positional Error (m)0.0159 | 3 | |
| Model-Based Optimization | square | Positional Error (m)0.0163 | 3 | |
| Model-Based Optimization | Triangle | Positional Error (m)0.0185 | 3 |