Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting

About

Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications among endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates streamlined Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://EndoGSLAM.loping151.com

Kailing Wang, Chen Yang, Yuehao Wang, Sikuang Li, Yan Wang, Qi Dou, Xiaokang Yang, Wei Shen• 2024

Related benchmarks

TaskDatasetResultRank
Camera LocalizationStereoMIS (P2-3)
RMSE0.001
16
Camera LocalizationStereoMIS (P2-4)
RMSE34.95
16
Camera LocalizationStereoMIS Average
RMSE27.12
16
Camera LocalizationStereoMIS (P2-2)
RMSE39.68
16
Camera LocalizationStereoMIS (P2-5)
RMSE33.84
14
4D ReconstructionEndoMapper Sequence 1
PSNR17.452
14
4D ReconstructionEndoMapper Sequence 2
PSNR17.29
14
4D ReconstructionEndoMapper Sequence 3
PSNR11.755
14
Novel View SynthesisC3VD average across ten scenes
PSNR22.16
10
Camera LocalizationC3VD c1_sigmoid2_t4_v4 v2
RMSE17.01
9
Showing 10 of 42 rows

Other info

Code

Follow for update