CylinderSplat: 3D Gaussian Splatting with Cylindrical Triplanes for Panoramic Novel View Synthesis
About
Feed-forward 3D Gaussian Splatting (3DGS) has shown great promise for real-time novel view synthesis, but its application to panoramic imagery remains challenging. Existing methods often rely on multi-view cost volumes for geometric refinement, which struggle to resolve occlusions in sparse-view scenarios. Furthermore, standard volumetric representations like Cartesian Triplanes are poor in capturing the inherent geometry of $360^\circ$ scenes, leading to distortion and aliasing. In this work, we introduce CylinderSplat, a feed-forward framework for panoramic 3DGS that addresses these limitations. The core of our method is a new {cylindrical Triplane} representation, which is better aligned with panoramic data and real-world structures adhering to the Manhattan-world assumption. We use a dual-branch architecture: a pixel-based branch reconstructs well-observed regions, while a volume-based branch leverages the cylindrical Triplane to complete occluded or sparsely-viewed areas. Our framework is designed to flexibly handle a variable number of input views, from single to multiple panoramas. Extensive experiments demonstrate that CylinderSplat achieves state-of-the-art results in both single-view and multi-view panoramic novel view synthesis, outperforming previous methods in both reconstruction quality and geometric accuracy.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Two-view reconstruction | Matterport3D (test) | WS-PSNR28.89 | 18 | |
| Novel View Synthesis | Matterport3D (train) | Training Time (s/iter)0.81 | 6 | |
| Two-view reconstruction | Replica (test) | WS-PSNR30.29 | 6 | |
| Two-view reconstruction | Residential (test) | WS-PSNR28.25 | 6 | |
| Two-view reconstruction | 360Loc | WS-PSNR28.35 | 5 | |
| Depth Estimation | Matterport3D 2.0m baseline | AbsRel0.2 | 4 | |
| Depth Estimation | Matterport3D 1.5m baseline | Absolute Relative Error (AbsRel)17 | 4 | |
| Depth Estimation | Matterport3D 1.0m baseline | Absolute Relative Error (AbsRel)0.11 | 4 | |
| Novel View Synthesis | Kansas Dataset extreme 20m–30m baseline | PCC0.63 | 4 | |
| Novel View Synthesis | 360Loc 4.5m Baseline | PCC0.86 | 4 |