Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TripleC Learning and Lightweight Speech Enhancement for Multi-Condition Target Speech Extraction

About

In our recent work, we proposed Lightweight Speech Enhancement Guided Target Speech Extraction (LGTSE) and demonstrated its effectiveness in multi-speaker-plus-noise scenarios. However, real-world applications often involve more diverse and complex conditions, such as one-speaker-plus-noise or two-speaker-without-noise. To address this challenge, we extend LGTSE with a Cross-Condition Consistency learning strategy, termed TripleC Learning. This strategy is first validated under multi-speaker-plus-noise condition and then evaluated for its generalization across diverse scenarios. Moreover, building upon the lightweight front-end denoiser in LGTSE, which can flexibly process both noisy and clean mixtures and shows strong generalization to unseen conditions, we integrate TripleC learning with a proposed parallel universal training scheme that organizes batches containing multiple scenarios for the same target speaker. By enforcing consistent extraction across different conditions, easier cases can assist harder ones, thereby fully exploiting diverse training data and fostering a robust universal model. Experimental results on the Libri2Mix three-condition tasks demonstrate that the proposed LGTSE with TripleC learning achieves superior performance over condition-specific models, highlighting its strong potential for universal deployment in real-world speech applications.

Ziling Huang• 2025

Related benchmarks

TaskDatasetResultRank
Target Speech ExtractionLibri2Mix 100 16kHz (test)
SI-SDR15.23
8
Target Speech ExtractionLibri2Mix 100 2-speaker+noise 16kHz (test)
PESQ2.33
8
Target Speech ExtractionLibri2Mix-100 (1-speaker+noise) 16kHz (test)
SI-SDR14.51
7
Target Speech ExtractionLibri2Mix-360 2-speaker 16kHz (test)--
1
Target Speech ExtractionLibri2Mix 360 2-speaker+noise 16kHz (test)--
1
Showing 5 of 5 rows

Other info

Follow for update