Investigating Training Objectives for Generative Speech Enhancement
About
Generative speech enhancement has recently shown promising advancements in improving speech quality in noisy environments. Multiple diffusion-based frameworks exist, each employing distinct training objectives and learning techniques. This paper aims to explain the differences between these frameworks by focusing our investigation on score-based generative models and the Schr\"odinger bridge. We conduct a series of comprehensive experiments to compare their performance and highlight differing training behaviors. Furthermore, we propose a novel perceptual loss function tailored for the Schr\"odinger bridge framework, demonstrating enhanced performance and improved perceptual quality of the enhanced speech signals. All experimental code and pre-trained models are publicly available to facilitate further research and development in this domain.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Speech Enhancement | VoiceBank + DEMAND (VB-DMD) (test) | PESQ3.7 | 105 | |
| Speech Enhancement | URGENT Speech Enhancement Challenge 50-sample 2024 (test) | MOS3.73 | 12 | |
| Speech Enhancement | URGENT 2024 (test) | PESQ2.57 | 12 |