Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

U$^{2}$Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation

About

Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U$^{2}$Flow, the first recurrent unsupervised framework that jointly estimates optical flow and per-pixel uncertainty. The core innovation is a decoupled learning strategy that derives uncertainty supervision from augmentation consistency via a Laplace-based maximum likelihood objective, enabling stable training without ground truth. The predicted uncertainty is further integrated into the network to guide adaptive flow refinement and dynamically modulate the regional smoothness loss. Furthermore, we introduce an uncertainty-guided bidirectional flow fusion mechanism that enhances robustness in challenging regions. Extensive experiments on KITTI and Sintel demonstrate that U$^{2}$Flow achieves state-of-the-art performance among unsupervised methods while producing highly reliable uncertainty maps, validating the effectiveness of our joint estimation paradigm. The code is available at https://github.com/sunzunyi/U2FLOW.

Xunpei Sun, Wenwei Lin, Yi Chang, Gang Chen• 2026

Related benchmarks

TaskDatasetResultRank
Optical Flow EstimationKITTI 2015 (train)
Fl-epe1.74
446
Optical Flow EstimationSintel Final (test)
EPE4.1
133
Optical FlowKITTI 2012 (train)--
115
Optical FlowKITTI 2015 (test)
Fl Error (All)6
109
Optical FlowSintel Final (train)
EPE2.29
106
Optical FlowSintel Clean (train)
EPE1.36
98
Optical FlowKITTI 2012 (test)
EPE1.3
66
Optical FlowSintel clean (test)--
37
Optical FlowSpring benchmark
1px Outlier Rate (Total)6.32
6
Uncertainty EstimationKITTI 2012, 2015 (train)
AUSE0.12
4
Showing 10 of 11 rows

Other info

Follow for update