Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GeoDTR+: Toward generic cross-view geolocalization via geometric disentanglement

About

Cross-View Geo-Localization (CVGL) estimates the location of a ground image by matching it to a geo-tagged aerial image in a database. Recent works achieve outstanding progress on CVGL benchmarks. However, existing methods still suffer from poor performance in cross-area evaluation, in which the training and testing data are captured from completely distinct areas. We attribute this deficiency to the lack of ability to extract the geometric layout of visual features and models' overfitting to low-level details. Our preliminary work introduced a Geometric Layout Extractor (GLE) to capture the geometric layout from input features. However, the previous GLE does not fully exploit information in the input feature. In this work, we propose GeoDTR+ with an enhanced GLE module that better models the correlations among visual features. To fully explore the LS techniques from our preliminary work, we further propose Contrastive Hard Samples Generation (CHSG) to facilitate model training. Extensive experiments show that GeoDTR+ achieves state-of-the-art (SOTA) results in cross-area evaluation on CVUSA, CVACT, and VIGOR by a large margin ($16.44\%$, $22.71\%$, and $13.66\%$ without polar transformation) while keeping the same-area performance comparable to existing SOTA. Moreover, we provide detailed analyses of GeoDTR+. Our code will be available at https://gitlab.com/vail-uvm/geodtr plus.

Xiaohan Zhang, Xingyu Li, Waqas Sultani, Chen Chen, Safwan Wshah• 2023

Related benchmarks

TaskDatasetResultRank
Cross-view geo-localizationCVACT (test)
R@167.57
50
Cross-view geo-localizationCVACT (val)
R@187.61
47
Cross-view geo-localizationVIGOR (Cross-Area)
Rank@136.01
40
Cross-view geo-localizationVIGOR (Same-Area)
R@159.01
40
Cross-view geo-localizationCVUSA (test)
R@1%99.75
28
Cross-view geo-localizationSpaGBOL 1.0 (test)
Top-1 Accuracy17.49
28
Cross-view geo-localizationVIGOR-Graph 1.0 (test)
Top-1 Accuracy3.09
28
Showing 7 of 7 rows

Other info

Follow for update