DeepFilterNet: Perceptually Motivated Real-Time Speech Enhancement
About
Multi-frame algorithms for single-channel speech enhancement are able to take advantage from short-time correlations within the speech signal. Deep Filtering (DF) was proposed to directly estimate a complex filter in frequency domain to take advantage of these correlations. In this work, we present a real-time speech enhancement demo using DeepFilterNet. DeepFilterNet's efficiency is enabled by exploiting domain knowledge of speech production and psychoacoustic perception. Our model is able to match state-of-the-art speech enhancement benchmarks while achieving a real-time-factor of 0.19 on a single threaded notebook CPU. The framework as well as pretrained weights have been published under an open source license.
Hendrik Schr\"oter, Tobias Rosenkranz, Alberto N. Escalante-B., Andreas Maier• 2023
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Speech Enhancement | VoiceBank + DEMAND (VB-DMD) (test) | PESQ3.16 | 105 | |
| Speech Enhancement | VoiceBank-DEMAND (test) | PESQ3.17 | 96 | |
| Speech Enhancement | Multilingual low-SNR (evaluation set) | PESQ2.76 | 23 | |
| Audio Denoising | VB-DMD | PESQ3.16 | 8 | |
| Audio Denoising | DNS1 no-reverb | PESQ2.58 | 7 |
Showing 5 of 5 rows