Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Differentiable Ray Tracing with Gaussians for Unified Radio Propagation Simulation and View Synthesis

About

Explicit neural representations such as 3D Gaussian Splatting (3DGS) enable high-fidelity and real-time novel view synthesis, yet optimize for alpha-composited optical appearance rather than ray-intersectable geometry. In contrast, radio-frequency (RF) digital twins require deterministic multi-bounce paths, where the geometry dictates trajectories and their associated attenuation and delay. We introduce a framework enabling differentiable RF propagation simulation directly within visually reconstructed neural scenes, allowing point-to-point path computation between arbitrary 3D locations while preserving high-quality visual rendering. Unlike conventional RF simulation pipelines that rely on manually constructed meshes, we embed Gaussian primitives into a hardware-accelerated ray tracing structure as the underlying spatial representation. By extracting physically meaningful channel impulse responses from visual-only reconstructions, we provide cross-modal evidence that neural reconstructions can serve as unified spatial representations for both electromagnetic propagation simulation and photorealistic view synthesis.

Niklas Vaara, Lam Huynh, Pekka Sangi, Miguel Bordallo L\'opez, Janne Heikkil\"a• 2026

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisMipNeRF 360 Indoor
PSNR29.55
126
Novel View SynthesisMipNeRF 360 Outdoor
PSNR24.11
123
RMS delay spread estimationAuditorium scene 234 GHz (test)
τrms1.56
6
Received Signal Strength PredictionRF3DGS 1 reflection & LoS
Mean RSS (dBm)-53.43
2
Received Signal Strength PredictionRF3DGS 2 reflections & LoS
Mean RSS (dBm)-52.31
2
Showing 5 of 5 rows

Other info

Follow for update