Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multi-Level Embedding and Alignment Network with Consistency and Invariance Learning for Cross-View Geo-Localization

About

Cross-View Geo-Localization (CVGL) involves determining the localization of drone images by retrieving the most similar GPS-tagged satellite images. However, the imaging gaps between platforms are often significant and the variations in viewpoints are substantial, which limits the ability of existing methods to effectively associate cross-view features and extract consistent and invariant characteristics. Moreover, existing methods often overlook the problem of increased computational and storage requirements when improving model performance. To handle these limitations, we propose a lightweight enhanced alignment network, called the Multi-Level Embedding and Alignment Network (MEAN). The MEAN network uses a progressive multi-level enhancement strategy, global-to-local associations, and cross-domain alignment, enabling feature communication across levels. This allows MEAN to effectively connect features at different levels and learn robust cross-view consistent mappings and modality-invariant features. Moreover, MEAN adopts a shallow backbone network combined with a lightweight branch design, effectively reducing parameter count and computational complexity. Experimental results on the University-1652 and SUES-200 datasets demonstrate that MEAN reduces parameter count by 62.17% and computational complexity by 70.99% compared to state-of-the-art models, while maintaining competitive or even superior performance. Our code and models will be released on https://github.com/ISChenawei/MEAN.

Zhongwei Chen, Zhao-Xu Yang, Hai-Jun Rong• 2024

Related benchmarks

TaskDatasetResultRank
Cross-view geo-localizationUniversity-1652 Drone -> Satellite
R@193.55
69
Cross-view geo-localizationUniversity-1652 Satellite -> Drone
R@196.01
57
Drone-to-Satellite RetrievalSUES-200 250m
R@1100
54
Drone-to-Satellite RetrievalSUES-200 150m
R@197.5
54
Drone-to-Satellite RetrievalSUES-200 200m
R@1 Accuracy100
44
Drone-to-Satellite RetrievalSUES-200 300m
R@1100
44
Showing 6 of 6 rows

Other info

Follow for update