PhyPush: One Push is All You Need for Sensorless Physical Property Estimation with Physics-Guided Transformers
About
Accurately estimating object mass and friction is fundamental to reliable robotic manipulation. While interactive perception is powerful, most approaches rely on specialized hardware like force/torque sensors, limiting scalability. This paper introduces PhyPush, a physics-guided Transformer that estimates an object's mass and friction coefficient using only end-effector velocity from a single push, data readily available on standard robotic arms. By incorporating Newton's second law and the Coulomb friction model through a physics-guided loss, the model improves physical consistency and generalizes to unseen objects and surfaces. Across diverse setups, PhyPush consistently achieves highly accurate estimations in challenging out-of-domain conditions. In simulation, it reduces error by over 10% compared to a baseline with privileged force data, while in real-world experiments, it successfully zero-shot transfers from simulation to outperform a purely data-driven baseline.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Physical Parameter Estimation | Isaac Lab Simulation Dm OOD (test) | Mass NRMSE19.8 | 10 | |
| Physical Parameter Estimation | Isaac Lab Simulation Dµ out-of-distribution (test) | Mass NRMSE3.4 | 5 | |
| Physical Parameter Estimation | Isaac Lab Simulation Overall aggregated (test) | Mass NRMSE0.146 | 5 | |
| Physical Parameter Estimation | Isaac Lab Simulation in-distribution (test) | Mass NRMSE0.023 | 5 |