Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DGC-Net: Dense Geometric Correspondence Network

About

This paper addresses the challenge of dense pixel correspondence estimation between two images. This problem is closely related to optical flow estimation task where ConvNets (CNNs) have recently achieved significant progress. While optical flow methods produce very accurate results for the small pixel translation and limited appearance variation scenarios, they hardly deal with the strong geometric transformations that we consider in this work. In this paper, we propose a coarse-to-fine CNN-based framework that can leverage the advantages of optical flow approaches and extend them to the case of large transformations providing dense and subpixel accurate estimates. It is trained on synthetic transformations and demonstrates very good performance to unseen, realistic, data. Further, we apply our method to the problem of relative camera pose estimation and demonstrate that the model outperforms existing dense approaches.

Iaroslav Melekhov, Aleksei Tiulpin, Torsten Sattler, Marc Pollefeys, Esa Rahtu, Juho Kannala• 2018

Related benchmarks

TaskDatasetResultRank
Optical Flow EstimationKITTI 2015 (train)
Fl-epe14.97
431
Optical FlowKITTI 2012 (train)
AEE8.5
115
Geometric MatchingHPatches 240 x 240
AEE (I)1.74
33
Geometric MatchingHPatches Original Resolution 3
AEPE Threshold I5.71
31
Geometric MatchingMegaDepth (test)
PCK@14.1
22
Geometric MatchingETH3D Original Resolution
AEPE (Rate 3)2.49
19
Geometric MatchingHPatches
AEE (Avg)25.05
14
Geometric MatchingRobotCar (test)
PCK@11.19
9
Correspondence MatchingHPatches (test)
AEPE33.26
7
Correspondence MatchingETH3D (test)
AEPE (rate=3)2.49
7
Showing 10 of 12 rows

Other info

Follow for update