U$^{2}$Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation
About
Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U$^{2}$Flow, the first recurrent unsupervised framework that jointly estimates optical flow and per-pixel uncertainty. The core innovation is a decoupled learning strategy that derives uncertainty supervision from augmentation consistency via a Laplace-based maximum likelihood objective, enabling stable training without ground truth. The predicted uncertainty is further integrated into the network to guide adaptive flow refinement and dynamically modulate the regional smoothness loss. Furthermore, we introduce an uncertainty-guided bidirectional flow fusion mechanism that enhances robustness in challenging regions. Extensive experiments on KITTI and Sintel demonstrate that U$^{2}$Flow achieves state-of-the-art performance among unsupervised methods while producing highly reliable uncertainty maps, validating the effectiveness of our joint estimation paradigm. The code is available at https://github.com/sunzunyi/U2FLOW.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Optical Flow Estimation | KITTI 2015 (train) | Fl-epe1.74 | 446 | |
| Optical Flow Estimation | Sintel Final (test) | EPE4.1 | 133 | |
| Optical Flow | KITTI 2012 (train) | -- | 115 | |
| Optical Flow | KITTI 2015 (test) | Fl Error (All)6 | 109 | |
| Optical Flow | Sintel Final (train) | EPE2.29 | 106 | |
| Optical Flow | Sintel Clean (train) | EPE1.36 | 98 | |
| Optical Flow | KITTI 2012 (test) | EPE1.3 | 66 | |
| Optical Flow | Sintel clean (test) | -- | 37 | |
| Optical Flow | Spring benchmark | 1px Outlier Rate (Total)6.32 | 6 | |
| Uncertainty Estimation | KITTI 2012, 2015 (train) | AUSE0.12 | 4 |