UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learning
About
We present an unsupervised learning approach for optical flow estimation by improving the upsampling and learning of pyramid network. We design a self-guided upsample module to tackle the interpolation blur problem caused by bilinear upsampling between pyramid levels. Moreover, we propose a pyramid distillation loss to add supervision for intermediate levels via distilling the finest flow as pseudo labels. By integrating these two components together, our method achieves the best performance for unsupervised optical flow learning on multiple leading benchmarks, including MPI-SIntel, KITTI 2012 and KITTI 2015. In particular, we achieve EPE=1.4 on KITTI 2012 and F1=9.38% on KITTI 2015, which outperform the previous state-of-the-art methods by 22.2% and 15.7%, respectively.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Optical Flow Estimation | KITTI 2015 (train) | Fl-epe2.45 | 431 | |
| Optical Flow Estimation | MPI Sintel Final (train) | Endpoint Error (EPE)2.67 | 209 | |
| Optical Flow Estimation | MPI Sintel Clean (train) | -- | 202 | |
| Optical Flow | MPI Sintel Clean (test) | AEE4.68 | 158 | |
| Optical Flow | MPI-Sintel final (test) | -- | 137 | |
| Optical Flow | KITTI 2012 (train) | -- | 115 | |
| Optical Flow Estimation | Sintel clean (test) | EPE4.68 | 103 | |
| Optical Flow Estimation | Sintel Final (test) | EPE5.32 | 101 | |
| Optical Flow | KITTI 2015 (test) | Fl Error (All)9.38 | 95 | |
| Optical Flow | Sintel Final (train) | EPE2.67 | 92 |