CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications
About
Estimating 2D camera motion is fundamental to computer vision and computational photography. Existing homography-based methods work well for planar scenes or pure rotation, but struggle with camera translation, depth variation, and local parallax; local homography and mesh-based models improve flexibility but still rely on piecewise planar assumptions. We introduce CamFlow+, a hybrid-basis framework that represents 2D camera motion directly in dense-flow space. CamFlow+ combines homography-derived physical bases, stochastic bases sampled from homography flows, and depth-translational bases derived from depth and camera intrinsics, relaxing the single-plane constraint while preserving camera-motion regularity. A depth-aware smoothness term further regularizes translation-induced parallax in continuous-depth regions while preserving motion changes near depth boundaries. We evaluate CamFlow+ on GHOF-Cam, a camera-motion benchmark that masks out dynamic objects and ill-posed occlusion regions in an optical-flow benchmark to isolate camera-induced motion. Experiments show that CamFlow+ improves sparse and dense camera-motion estimation. In digital video stabilization, CamFlow+ also improves global and local stability, achieving the best top-1 preference rate in a blind user study. Code and datasets will be available on the project page: https://lhaippp.github.io/CamFlow+.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Sparse Camera Motion Estimation | GHOF (test) | Average Error0.51 | 23 | |
| Dense Camera Motion Estimation | GHOF-Cam (test) | Average Error0.5 | 18 | |
| Homography Estimation | CAHomo (test) | Average Error (AVG)0.33 | 18 | |
| Perceptual Alignment Quality | GHOF-Cam LL (test) | PSNR32.24 | 14 | |
| Perceptual Alignment Quality | GHOF-Cam AVG (test) | PSNR32.3 | 14 | |
| Perceptual Alignment Quality | GHOF-Cam RE (test) | PSNR28.91 | 14 | |
| Perceptual Alignment Quality | GHOF-Cam FOG (test) | PSNR34.67 | 14 | |
| Perceptual Alignment Quality | GHOF-Cam RAIN (test) | PSNR30.4 | 14 | |
| Perceptual Alignment Quality | GHOF-Cam SNOW (test) | PSNR36.6 | 14 |