Reciprocal Latent Fields for Precomputed Sound Propagation
About
Realistic sound propagation is essential for immersion in a virtual scene, yet physically accurate wave-based simulations remain computationally prohibitive for real-time applications. Wave coding methods address this limitation by precomputing and compressing impulse responses of a given scene into a set of scalar acoustic parameters, which can reach unmanageable sizes in large environments with many source-receiver pairs. We introduce Reciprocal Latent Fields (RLF), a memory-efficient framework for encoding and predicting these acoustic parameters. The RLF framework employs a volumetric grid of trainable latent embeddings decoded with a symmetric function, ensuring acoustic reciprocity. We study a variety of decoders and show that leveraging Riemannian metric learning leads to a better reproduction of acoustic phenomena in complex scenes. Experimental validation demonstrates that RLF maintains replication quality while reducing the memory footprint by several orders of magnitude. Furthermore, a MUSHRA-like subjective listening test indicates that sound rendered via RLF is perceptually indistinguishable from ground-truth simulations.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Acoustic field reconstruction | Audio Gym | MAE pi (m)0.168 | 5 | |
| Acoustic field reconstruction | WAL | MAE pi (m)0.344 | 5 | |
| Subjective Realism Rating | Audio Gym Scene 1 | Mean Realism Score60.3 | 3 | |
| Subjective Realism Rating | Audio Gym Scene 3 | Mean Realism Score72.5 | 3 | |
| Subjective Realism Rating | Audio Gym Overall | Mean Realism Score61.8 | 3 | |
| Subjective Realism Rating | Audio Gym Scene 2 | Mean Realism Score54.6 | 3 | |
| Subjective Realism Rating | Audio Gym Scene 4 | Mean Realism Score56.4 | 3 | |
| Subjective Realism Rating | Audio Gym Scene 5 | Mean Realism Score65.4 | 3 |