Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

iPhonMatchNet: Zero-Shot User-Defined Keyword Spotting Using Implicit Acoustic Echo Cancellation

About

In response to the increasing interest in human--machine communication across various domains, this paper introduces a novel approach called iPhonMatchNet, which addresses the challenge of barge-in scenarios, wherein user speech overlaps with device playback audio, thereby creating a self-referencing problem. The proposed model leverages implicit acoustic echo cancellation (iAEC) techniques to increase the efficiency of user-defined keyword spotting models, achieving a remarkable 95% reduction in mean absolute error with a minimal increase in model size (0.13%) compared to the baseline model, PhonMatchNet. We also present an efficient model structure and demonstrate its capability to learn iAEC functionality without requiring a clean signal. The findings of our study indicate that the proposed model achieves competitive performance in real-world deployment conditions of smart devices.

Yong-Hyeok Lee, Namhyun Cho• 2023

Related benchmarks

TaskDatasetResultRank
User-defined keyword spottingLibriPhrase LPE (easy)
AUC99.59
9
User-defined keyword spottingLibriPhrase LPH hard
AUC88.23
9
User-defined keyword spottingLibriPhrase Balanced (combined)
AUC93.91
9
Showing 3 of 3 rows

Other info

Follow for update