Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Investigating Training Objectives for Generative Speech Enhancement

About

Generative speech enhancement has recently shown promising advancements in improving speech quality in noisy environments. Multiple diffusion-based frameworks exist, each employing distinct training objectives and learning techniques. This paper aims to explain the differences between these frameworks by focusing our investigation on score-based generative models and the Schr\"odinger bridge. We conduct a series of comprehensive experiments to compare their performance and highlight differing training behaviors. Furthermore, we propose a novel perceptual loss function tailored for the Schr\"odinger bridge framework, demonstrating enhanced performance and improved perceptual quality of the enhanced speech signals. All experimental code and pre-trained models are publicly available to facilitate further research and development in this domain.

Julius Richter, Danilo de Oliveira, Timo Gerkmann• 2024

Related benchmarks

TaskDatasetResultRank
Speech EnhancementVoiceBank + DEMAND (VB-DMD) (test)
PESQ3.7
105
Speech EnhancementURGENT Speech Enhancement Challenge 50-sample 2024 (test)
MOS3.73
12
Speech EnhancementURGENT 2024 (test)
PESQ2.57
12
Showing 3 of 3 rows

Other info

Follow for update