DGC-Net: Dense Geometric Correspondence Network
About
This paper addresses the challenge of dense pixel correspondence estimation between two images. This problem is closely related to optical flow estimation task where ConvNets (CNNs) have recently achieved significant progress. While optical flow methods produce very accurate results for the small pixel translation and limited appearance variation scenarios, they hardly deal with the strong geometric transformations that we consider in this work. In this paper, we propose a coarse-to-fine CNN-based framework that can leverage the advantages of optical flow approaches and extend them to the case of large transformations providing dense and subpixel accurate estimates. It is trained on synthetic transformations and demonstrates very good performance to unseen, realistic, data. Further, we apply our method to the problem of relative camera pose estimation and demonstrate that the model outperforms existing dense approaches.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Optical Flow Estimation | KITTI 2015 (train) | Fl-epe14.97 | 431 | |
| Optical Flow | KITTI 2012 (train) | AEE8.5 | 115 | |
| Geometric Matching | HPatches 240 x 240 | AEE (I)1.74 | 33 | |
| Geometric Matching | HPatches Original Resolution 3 | AEPE Threshold I5.71 | 31 | |
| Geometric Matching | MegaDepth (test) | PCK@14.1 | 22 | |
| Geometric Matching | ETH3D Original Resolution | AEPE (Rate 3)2.49 | 19 | |
| Geometric Matching | HPatches | AEE (Avg)25.05 | 14 | |
| Geometric Matching | RobotCar (test) | PCK@11.19 | 9 | |
| Correspondence Matching | HPatches (test) | AEPE33.26 | 7 | |
| Correspondence Matching | ETH3D (test) | AEPE (rate=3)2.49 | 7 |