Efficient Feature-Free Initialization for Monocular Visual-Inertial Systems Using a Feed-Forward 3D Model
About
Fast and reliable initialization is critical for monocular visual-inertial navigation systems (VINS), as it establishes the starting conditions for subsequent state estimation. Despite steady progress, most existing methods heavily rely on visual feature correspondences and require 3-4 seconds of sensory data for successful initialization, which limits their applicability and efficiency. With the advent of feed-forward 3D models that can directly predict point clouds from images, we revisit the visual-inertial initialization problem from a concise perspective. In this work, we propose a feature-free initialization framework that leverages up-to-scale point clouds predicted by a feed-forward 3D model, thereby obviating the need for visual feature tracking and estimation. This design substantially reduces system complexity and improves the reliability of initialization. Experiments on public datasets demonstrate that the proposed feature-free initialization method achieves the highest success rate, exceeding 90%, and significantly reduces the data duration required for successful initialization, typically to under 1.2 s. We further validate our method on a self-collected dataset covering various indoor and outdoor scenarios, demonstrating robust performance, particularly in visually degraded environments where existing methods often fail. The code and dataset are available at https://github.com/Yuantai-Z/FF-VIO-Init.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visual-Inertial Initialization | Self-collected dataset | Success Rate (%)90 | 7 | |
| Visual-Inertial Initialization | EuRoC MAV dataset | Windowed ATE (deg)1.2 | 7 | |
| Linear System Evaluation (VINS Initialization) | EuRoC V1_01 | Gravity Error2.05 | 6 | |
| Linear System Evaluation (VINS Initialization) | EuRoC V1_02 | Gravity Error3.12 | 6 | |
| Linear System Evaluation (VINS Initialization) | EuRoC Average | Gravity Error3.54 | 6 | |
| Linear System Evaluation (VINS Initialization) | EuRoC V2_02 | Gravity Error (deg)3.99 | 6 | |
| Linear System Evaluation (VINS Initialization) | EuRoC V1_03 | Gravity Error6.11 | 6 | |
| Linear System Evaluation (VINS Initialization) | EuRoC V2_01 | Gravity Error2.01 | 6 | |
| Linear System Evaluation (VINS Initialization) | EuRoC V2_03 | Gravity Error3.47 | 6 | |
| Visual-Inertial Initialization | TUM-VI (room1) | Gravity Error (deg)3.35 | 4 |