Personalized Keyword Spotting for User-Defined Keywords Leveraging Text-Independent Speaker Verification
About
User-defined keyword spotting (UD-KWS) enables zero-shot wake-word detection from text, but existing systems learn speaker-invariant representations that cannot reject impostors uttering the correct keyword. We address this dual zero-shot setting -- unseen keywords and unseen speakers -- with ZP-KWS, a lightweight framework combining a phoneme-supervised audio encoder with a GE2E-pretrained compact speaker encoder (about 0.9M parameters). Multiplicative late fusion at inference grants each branch independent veto power, supporting modes from conventional detection to strict speaker-gated activation without retraining. On LibriPhrase, Google Speech Commands, and Qualcomm datasets, ZP-KWS reduces target-only FRR at 1% FAR by up to 60% relative to the strongest baseline while maintaining competitive keyword detection, all within a 1.55M parameter budget for edge deployment.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Personalized Keyword Spotting | LibriPhrase easy | C-KWS FRR @ 1%5.71 | 6 | |
| Personalized Keyword Spotting | LibriPhrase hard | C-KWS FRR@1%80.59 | 6 | |
| Personalized Keyword Spotting | Qualcomm | C-KWS FRR@1%23.19 | 6 | |
| Personalized Keyword Spotting | Google Speech Commands | C-KWS FRR@1%28.05 | 6 |