Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping

About

Long-horizon online visual mapping is a core capability for robot perception, requiring continuous camera-motion and scene-geometry estimation from visual streams under bounded memory and computation. Recent feed-forward 3D reconstruction models provide strong geometric priors, but their streaming variants often predict poses in a fixed coordinate system tied to the first frame or a persistent scene memory. This fixed-gauge design leads to train--test mismatch, attention bias toward early anchors, and accumulated drift on sequences much longer than those seen during training. We propose \emph{Anchor3R}, a streaming 3D reconstruction framework that treats feed-forward reconstruction as current-centric local measurement prediction rather than persistent global-gauge regression. At each time step, Anchor3R predicts window-relative poses and a local pointmap in the current-frame coordinate system, turning streaming reconstruction into relative-pose measurement generation. These measurements support online pose updates, while loop-closure reinsertion and motion averaging align the trajectory and transform local pointmaps into a coherent global reconstruction. Experiments on indoor, outdoor, driving, and RGB-D benchmarks show that Anchor3R improves long-horizon pose accuracy and dense reconstruction quality over existing streaming baselines, while supporting bounded-memory online inference.

Peilin Tao, Chong Cheng, Yuansen Du, Caiwei Song, Zhengqing Chen, Xiaoyang Guo, Wei Yin, Weiqiang Ren, Qian Zhang, Hainan Cui, Shuhan Shen• 2026

Related benchmarks

TaskDatasetResultRank
3D Reconstruction7 Scenes--
161
Camera pose estimationOxford Spires
ATE17.661
35
Pose EstimationWaymo
ATE (m)0.425
22
Dense ReconstructionTUM RGB-D
Chamfer Distance0.108
13
Camera pose estimationKITTI Odometry 48 (00-10)
ATE (Seq 01)48.43
11
Camera pose estimationTUM short indoor trajectories
ATE0.091
9
Camera pose estimationVBR (train)
Campus Sequence Error (train0)5.13
7
Showing 7 of 7 rows

Other info

Follow for update