Radioactive 3D Gaussian Ray Tracing for Tomographic Reconstruction
About
3D Gaussian Splatting (3DGS) has recently emerged in computer vision as a promising rendering technique. By adapting the principles of Elliptical Weighted Average (EWA) splatting to a modern differentiable pipeline, 3DGS enables real-time, high-quality novel view synthesis. Building upon this, R2-Gaussian extended the 3DGS paradigm to tomographic reconstruction by rectifying integration bias, achieving state-of-the-art performance in computed tomography (CT). To enable differentiability, R2-Gaussian adopts a local affine approximation: each 3D Gaussian is locally mapped to a 2D Gaussian on the detector and composed via alpha blending to form projections. However, the affine approximation can degrade reconstruction quantitative accuracy and complicate the incorporation of nonlinear geometric corrections. To address these limitations, we propose a tomographic reconstruction framework based on 3D Gaussian ray tracing. Our approach provides two key advantages over splatting-based models: (i) it computes the line integral through 3D Gaussian primitives analytically, avoiding the local affine collapse and thus yielding a more physically consistent forward projection model; and (ii) the ray-tracing formulation gives explicit control over ray origins and directions, which facilitates the precise application of nonlinear geometric corrections, e.g., arc-correction used in positron emission tomography (PET). These properties extend the applicability of Gaussian-based reconstruction to a wider range of realistic tomography systems while improving projection accuracy.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Tomographic reconstruction | real-world CT dataset | PSNR35.79 | 6 | |
| Signal-to-background ratio measurement | NEMA phantom (test) | SBR Sphere 03 | 3 | |
| PET Image Reconstruction Diameter Measurement | NEMA phantom | Diameter (Sphere 0) (mm)9.5 | 3 | |
| Tomographic reconstruction | NEMA phantom STIR v6.2 (simulation) | Time (min)35 | 3 | |
| CT Reconstruction | Synthetic CT 75 views | PSNR39.36 | 2 | |
| CT Reconstruction | Synthetic CT 50 views | PSNR35.13 | 2 | |
| CT Reconstruction | Synthetic CT 25 views | PSNR32.99 | 2 |