MAGICIAN: Efficient Long-Term Planning with Imagined Gaussians for Active Mapping
About
Active mapping aims to determine how an agent should move to efficiently reconstruct unknown environments. Most existing approaches rely on greedy next-best-view prediction, resulting in inefficient exploration and incomplete reconstruction. To address this, we introduce MAGICIAN, a novel long-term planning framework that maximizes accumulated surface coverage gain through Imagined Gaussians, a scene representation based on 3D Gaussian Splatting, derived from a pre-trained occupancy network with strong structural priors. This representation enables efficient coverage gain computation for any novel viewpoint via fast volumetric rendering, allowing its integration into a tree-search algorithm for long-horizon planning. We update Imagined Gaussians and refine the trajectory in a closed loop. Our method achieves state-of-the-art performance across indoor and outdoor benchmarks with varying action spaces, highlighting the advantage of long-term planning in active mapping.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Active Mapping | MP3D | Completion (%)96.83 | 10 | |
| Active Mapping | Macarons++ | AUC72.1 | 5 | |
| Mesh Reconstruction | large-scale real-world scanned scenes | Accuracy94.2 | 3 | |
| Novel View Synthesis | large-scale real-world scanned scenes | SSIM64 | 3 |