Differentiable Ray Tracing with Gaussians for Unified Radio Propagation Simulation and View Synthesis
About
Explicit neural representations such as 3D Gaussian Splatting (3DGS) enable high-fidelity and real-time novel view synthesis, yet optimize for alpha-composited optical appearance rather than ray-intersectable geometry. In contrast, radio-frequency (RF) digital twins require deterministic multi-bounce paths, where the geometry dictates trajectories and their associated attenuation and delay. We introduce a framework enabling differentiable RF propagation simulation directly within visually reconstructed neural scenes, allowing point-to-point path computation between arbitrary 3D locations while preserving high-quality visual rendering. Unlike conventional RF simulation pipelines that rely on manually constructed meshes, we embed Gaussian primitives into a hardware-accelerated ray tracing structure as the underlying spatial representation. By extracting physically meaningful channel impulse responses from visual-only reconstructions, we provide cross-modal evidence that neural reconstructions can serve as unified spatial representations for both electromagnetic propagation simulation and photorealistic view synthesis.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | MipNeRF 360 Indoor | PSNR29.55 | 126 | |
| Novel View Synthesis | MipNeRF 360 Outdoor | PSNR24.11 | 123 | |
| RMS delay spread estimation | Auditorium scene 234 GHz (test) | τrms1.56 | 6 | |
| Received Signal Strength Prediction | RF3DGS 1 reflection & LoS | Mean RSS (dBm)-53.43 | 2 | |
| Received Signal Strength Prediction | RF3DGS 2 reflections & LoS | Mean RSS (dBm)-52.31 | 2 |