Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BAE-Net: A Low complexity and high fidelity Bandwidth-Adaptive neural network for speech super-resolution

About

Speech bandwidth extension (BWE) has demonstrated promising performance in enhancing the perceptual speech quality in real communication systems. Most existing BWE researches primarily focus on fixed upsampling ratios, disregarding the fact that the effective bandwidth of captured audio may fluctuate frequently due to various capturing devices and transmission conditions. In this paper, we propose a novel streaming adaptive bandwidth extension solution dubbed BAE-Net, which is suitable to handle the low-resolution speech with unknown and varying effective bandwidth. To address the challenges of recovering both the high-frequency magnitude and phase speech content blindly, we devise a dual-stream architecture that incorporates the magnitude inpainting and phase refinement. For potential applications on edge devices, this paper also introduces BAE-NET-lite, which is a lightweight, streaming and efficient framework. Quantitative results demonstrate the superiority of BAE-Net in terms of both performance and computational efficiency when compared with existing state-of-the-art BWE methods.

Guochen Yu, Xiguang Zheng, Nan Li, Runqiang Han, Chengshi Zheng, Chen Zhang, Chao Zhou, Qi Huang, Bing Yu• 2023

Related benchmarks

TaskDatasetResultRank
Bandwidth extensionVCTK 16 kHz -> 48 kHz v0.92 (test)
LSD0.722
6
Bandwidth extensionVCTK 4 kHz -> 48 kHz v0.92 (test)
LSD0.9894
6
Speech Bandwidth ExtensionEARS zero-shot
LSD1.3257
5
Showing 3 of 3 rows

Other info

Follow for update