Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SEMamba++: A General Speech Restoration Framework Leveraging Global, Local, and Periodic Spectral Patterns

About

General speech restoration demands techniques that can interpret complex speech structures under various distortions. While State-Space Models like SEMamba have advanced the state-of-the-art in speech denoising, they are not inherently optimized for critical speech characteristics, such as spectral periodicity or multi-resolution frequency analysis. In this work, we introduce an architecture tailored to incorporate speech-specific features as inductive biases. In particular, we propose Frequency GLP, a frequency feature extraction block that effectively and efficiently leverages the properties of frequency bins. Then, we design a multi-resolution parallel time-frequency dual-processing block to capture diverse spectral patterns, and a learnable mapping to further enhance model performance. With all our ideas combined, the proposed SEMamba++ achieves the best performance among multiple baseline models while remaining computationally efficient.

Yongjoon Lee, Jung-Woo Choi• 2026

Related benchmarks

TaskDatasetResultRank
General Speech RestorationDNS-Real Out-Domain (test)
SIG3.487
17
General Speech RestorationVCTK-GSR (test)
SCOREQ3.27
7
General Speech RestorationURGENT 2025 (val)
SCOREQ2.67
7
General Speech RestorationURGENT 2025 (test)
SCOREQ2.49
7
Speech RestorationCCF-AATC Challenge 2025 (test)
SIG3.45
7
Showing 5 of 5 rows

Other info

Follow for update