GOReloc: Graph-based Object-Level Relocalization for Visual SLAM
About
This article introduces a novel method for object-level relocalization of robotic systems. It determines the pose of a camera sensor by robustly associating the object detections in the current frame with 3D objects in a lightweight object-level map. Object graphs, considering semantic uncertainties, are constructed for both the incoming camera frame and the pre-built map. Objects are represented as graph nodes, and each node employs unique semantic descriptors based on our devised graph kernels. We extract a subgraph from the target map graph by identifying potential object associations for each object detection, then refine these associations and pose estimations using a RANSAC-inspired strategy. Experiments on various datasets demonstrate that our method achieves more accurate data association and significantly increases relocalization success rates compared to baseline methods. The implementation of our method is released at \url{https://github.com/yutongwangBIT/GOReloc}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Camera Relocalization | ScanNet v1 (test) | Recall @50cm25 | 32 | |
| Pose Estimation | COCO Categories Resort_1 sequence (test) | F1 Score93.2 | 7 | |
| Pose Estimation | COCO Categories - Walk sequence (test) | F1 Score86.1 | 7 | |
| Pose Estimation | COCO Categories Fr2_desk sequence (test) | F1 Score89.9 | 7 | |
| Pose Estimation | LVIS Fr2_person sequence v1.0 | F189.4 | 5 | |
| Pose Estimation | LVIS v1.0 (Fr2_desk sequence) | F1 Score95.1 | 5 | |
| Pose Estimation | LVIS Resort_1 sequence v1.0 | F1 Score89.3 | 5 | |
| Pose Estimation | LVIS v1.0 (Resort_2 sequence) | F1 Score82 | 5 | |
| Pose Estimation | LVIS v1.0 (Walk sequence) | F1 Score91.4 | 5 | |
| Pose Estimation | LVIS Head sequence v1.0 | F1 Score78.9 | 5 |