Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

A Hyperdimensional One Place Signature to Represent Them All: Stackable Descriptors For Visual Place Recognition

About

Visual Place Recognition (VPR) enables coarse localization by comparing query images to a reference database of geo-tagged images. Recent breakthroughs in deep learning architectures and training regimes have led to methods with improved robustness to factors like environment appearance change, but with the downside that the required training and/or matching compute scales with the number of distinct environmental conditions encountered. Here, we propose Hyperdimensional One Place Signatures (HOPS) to simultaneously improve the performance, compute and scalability of these state-of-the-art approaches by fusing the descriptors from multiple reference sets captured under different conditions. HOPS scales to any number of environmental conditions by leveraging the Hyperdimensional Computing framework. Extensive evaluations demonstrate that our approach is highly generalizable and consistently improves recall performance across all evaluated VPR methods and datasets by large margins. Arbitrarily fusing reference images without compute penalty enables numerous other useful possibilities, three of which we demonstrate here: descriptor dimensionality reduction with no performance penalty, stacking synthetic images, and coarse localization to an entire traverse or environmental section.

Connor Malone, Somayeh Hussaini, Tobias Fischer, Michael Milford• 2024

Related benchmarks

TaskDatasetResultRank
Visual Place RecognitionOxford RobotCar (Dusk)
Recall@198.1
78
Visual Place RecognitionPittsburgh30k
Recall@184.9
48
Visual Place RecognitionNordland subsampled 2.5m (Fall query)
Recall@179.9
23
Visual Place RecognitionGLDv2 micro
Recall@183.2
18
Showing 4 of 4 rows

Other info

Follow for update