Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Riemannian and Symplectic Geometry for Hierarchical Text-Driven Place Recognition

About

Text-to-point-cloud localization enables robots to understand spatial positions through natural language descriptions, which is crucial for human-robot collaboration in applications such as autonomous driving and last-mile delivery. However, existing methods employ pooled global descriptors for similarity retrieval, which suffer from severe information loss and fail to capture discriminative scene structures. To address these issues, we propose SympLoc, a novel coarse-to-fine localization framework with multi-level alignment in the coarse stage. Different from previous methods that rely solely on global descriptors, our coarse stage consists of three complementary alignment levels: 1) Instance-level alignment establishes direct correspondence between individual object instances in point clouds and textual hints through Riemannian self-attention in hyperbolic space; 2) Relation-level alignment explicitly models pairwise spatial relationships between objects using the Information-Symplectic Relation Encoder (ISRE), which reformulates relation features through Fisher-Rao metric and Hamiltonian dynamics for uncertainty-aware geometrically consistent propagation; 3) Global-level alignment synthesizes discriminative global descriptors via the Spectral Manifold Transform (SMT) that extracts structural invariants through graph spectral analysis. This hierarchical alignment strategy progressively captures fine-grained to coarse-grained scene semantics, enabling robust cross-modal retrieval. Extensive experiments on the KITTI360Pose dataset demonstrate that SympLoc achieves a 19% improvement in Top-1 recall@10m compared to existing state-of-the-art approaches.

Tianyi Shang, Zhenyu Li• 2026

Related benchmarks

TaskDatasetResultRank
Text-based position localizationKITTI360 Pose (test)
Localization Recall (k=1, ε < 5m)52
21
Text-to-point cloud localizationKITTI360 Pose (val)
Recall@k=1 (5m)52
19
Text-to-point-cloud-submap retrievalKITTI360Pose (test)
Recall@10.51
17
Text-to-point-cloud-submap retrievalKITTI360Pose (val)
Recall@154
9
Showing 4 of 4 rows

Other info

Follow for update