UltraGS: Real-Time Physically-Decoupled Gaussian Splatting for Ultrasound Novel View Synthesis
About
Ultrasound imaging is a cornerstone of non-invasive clinical diagnostics, yet its limited field of view poses challenges for novel view synthesis. We present UltraGS, a real-time framework that adapts Gaussian Splatting to sensorless ultrasound imaging by integrating explicit radiance fields with lightweight, physics-inspired acoustic modeling. UltraGS employs depth-aware Gaussian primitives with learnable fields of view to improve geometric consistency under unconstrained probe motion, and introduces PD Rendering, a differentiable acoustic operator that combines low-order spherical harmonics with first-order wave effects for efficient intensity synthesis. We further present a clinical ultrasound dataset acquired under real-world scanning protocols. Extensive evaluations across three datasets demonstrate that UltraGS establishes a new performance-efficiency frontier, achieving state-of-the-art results in PSNR (up to 29.55) and SSIM (up to 0.89) while achieving real-time synthesis at 64.69 fps on a single GPU. The code and dataset are open-sourced at: https://github.com/Bean-Young/UltraGS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Ultrasound View Synthesis | Wild Dataset | PSNR25.454 | 6 | |
| Ultrasound View Synthesis | Phantom dataset | PSNR29.55 | 6 | |
| Ultrasound View Synthesis | Clinical Dataset Case1 | PSNR18.846 | 6 | |
| Ultrasound View Synthesis | Clinical Dataset Case2 | PSNR24.644 | 6 | |
| Ultrasound View Synthesis | Clinical Dataset Case3 | PSNR21.57 | 6 | |
| Ultrasound View Synthesis | Clinical Dataset Case4 | PSNR24.03 | 6 | |
| Ultrasound View Synthesis | Clinical Dataset Case5 | PSNR22.723 | 6 | |
| Ultrasound View Synthesis | Clinical Dataset Case6 | PSNR28.181 | 6 |