TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstruction
About
We present TokenSplat, a feed-forward framework for joint 3D Gaussian reconstruction and camera pose estimation from unposed multi-view images. At its core, TokenSplat introduces a Token-aligned Gaussian Prediction module that aligns semantically corresponding information across views directly in the feature space. Guided by coarse token positions and fusion confidence, it aggregates multi-scale contextual features to enable long-range cross-view reasoning and reduce redundancy from overlapping Gaussians. To further enhance pose robustness and disentangle viewpoint cues from scene semantics, TokenSplat employs learnable camera tokens and an Asymmetric Dual-Flow Decoder (ADF-Decoder) that enforces directionally constrained communication between camera and image tokens. This maintains clean factorization within a feed-forward architecture, enabling coherent reconstruction and stable pose estimation without iterative refinement. Extensive experiments demonstrate that TokenSplat achieves higher reconstruction fidelity and novel-view synthesis quality in pose-free settings, and significantly improves pose estimation accuracy compared to prior pose-free methods. Project page: https://kidleyh.github.io/tokensplat/.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | ScanNet | PSNR26.87 | 130 | |
| Novel View Synthesis | RE10K 8 views | PSNR26.15 | 22 | |
| Camera Pose Prediction | ScanNet (test) | ATE0.041 | 18 | |
| Novel View Synthesis | ScanNet 8 views | PSNR25.15 | 17 | |
| Novel View Synthesis | RE10K 4 views | PSNR25.14 | 15 | |
| Novel View Synthesis | ScanNet 4 views | PSNR28.15 | 15 | |
| Pose Prediction | RE10K 4 views (test) | ATE0.016 | 6 | |
| Pose Prediction | RE10K 8 views (test) | ATE0.012 | 6 | |
| Pose Prediction | ScanNet 4 views (test) | ATE0.062 | 6 | |
| Pose Prediction | ScanNet 8 views (test) | ATE0.088 | 6 |