Estimating Velocity and Spin of Spherical Objects from Rolling-Shutter Image(s)
About
Rolling-shutter cameras introduce characteristic distortions when imaging fast moving objects, and these effects are typically treated as artifacts to be corrected. In this work, we instead leverage rolling-shutter distortions as a valuable source of temporal information to estimate the 3D translational and angular velocities of rapidly moving spherical objects from a single rolling-shutter frame. We design a robust and easily detectable spherical pattern and propose a correspondence-free formulation that recovers motion by enforcing geometric consistency in a back-projection framework. By exploiting the geometry of the sphere, translational and rotational motions are decoupled and estimated through a two-stage optimization process, enabling reliable velocity recovery even for textureless objects. Extensive experiments on both synthetic and real datasets demonstrate accurate and robust estimation of motion parameters under challenging high-speed conditions.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Translational and Angular Velocity Estimation | 10 Golf Shots real-world 1.0 (test) | Speed122.2 | 22 | |
| Angular Velocity Estimation | Synthetic Data Scenario 3 Multi-Frames | MAE x (rad/s)4.58 | 4 | |
| Angular Velocity Estimation | Synthetic Data Scenario 4 (Stereo MF) | MAE X (rad/s)10.39 | 4 | |
| Translational Velocity Estimation | Synthetic Scenario 3 - Multi-Frame 1.0 (test) | MAE X (m/s)0.16 | 3 | |
| Translational Velocity Estimation | Synthetic Scenario 4 - Stereo MF 1.0 (test) | MAE X (m/s)0.19 | 3 | |
| Angular Velocity Estimation | Synthetic Data Scenario 1 (Single) | Mean Absolute Error X (rad/s)49.82 | 2 | |
| Angular Velocity Estimation | Synthetic Data Scenario 2 Stereo | MAE X (rad/s)33.11 | 2 | |
| Translational Velocity Estimation | Synthetic Scenario 1 - Single 1.0 (test) | MAE X (m/s)0.23 | 2 | |
| Translational Velocity Estimation | Synthetic Scenario 2 - Stereo 1.0 (test) | MAE X (m/s)0.12 | 2 |