Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Personalized Keyword Spotting for User-Defined Keywords Leveraging Text-Independent Speaker Verification

About

User-defined keyword spotting (UD-KWS) enables zero-shot wake-word detection from text, but existing systems learn speaker-invariant representations that cannot reject impostors uttering the correct keyword. We address this dual zero-shot setting -- unseen keywords and unseen speakers -- with ZP-KWS, a lightweight framework combining a phoneme-supervised audio encoder with a GE2E-pretrained compact speaker encoder (about 0.9M parameters). Multiplicative late fusion at inference grants each branch independent veto power, supporting modes from conventional detection to strict speaker-gated activation without retraining. On LibriPhrase, Google Speech Commands, and Qualcomm datasets, ZP-KWS reduces target-only FRR at 1% FAR by up to 60% relative to the strongest baseline while maintaining competitive keyword detection, all within a 1.55M parameter budget for edge deployment.

Ming-Hsiang Hu, Kuan-Tang Huang, Chien-Chun Wang, Hung-Shin Lee, Berlin Chen• 2026

Related benchmarks

TaskDatasetResultRank
Personalized Keyword SpottingLibriPhrase easy
C-KWS FRR @ 1%5.71
6
Personalized Keyword SpottingLibriPhrase hard
C-KWS FRR@1%80.59
6
Personalized Keyword SpottingQualcomm
C-KWS FRR@1%23.19
6
Personalized Keyword SpottingGoogle Speech Commands
C-KWS FRR@1%28.05
6
Showing 4 of 4 rows

Other info

Follow for update