Few-Shot Keyword Spotting With Prototypical Networks

07/25/2020
by   Archit Parnami, et al.
0

Recognizing a particular command or a keyword, keyword spotting has been widely used in many voice interfaces such as Amazon's Alexa and Google Home. In order to recognize a set of keywords, most of the recent deep learning based approaches use a neural network trained with a large number of samples to identify certain pre-defined keywords. This restricts the system from recognizing new, user-defined keywords. Therefore, we first formulate this problem as a few-shot keyword spotting and approach it using metric learning. To enable this research, we also synthesize and publish a Few-shot Google Speech Commands dataset. We then propose a solution to the few-shot keyword spotting problem using temporal and dilated convolutions on prototypical networks. Our comparative experimental results demonstrate keyword spotting of new keywords using just a small number of samples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/28/2022

Dummy Prototypical Networks for Few-Shot Open-Set Keyword Spotting

Keyword spotting is the task of detecting a keyword in streaming audio. ...
research
05/18/2023

TempAdaCos: Learning Temporally Structured Embeddings for Few-Shot Keyword Spotting with Dynamic Time Warping

Few-shot keyword spotting (KWS) systems often utilize a sliding window o...
research
11/01/2022

Metric Learning for User-defined Keyword Spotting

The goal of this work is to detect new spoken terms defined by users. Wh...
research
10/14/2021

Attention-Free Keyword Spotting

Till now, attention-based models have been used with great success in th...
research
06/03/2023

Few-Shot Open-Set Learning for On-Device Customization of KeyWord Spotting Systems

A personalized KeyWord Spotting (KWS) pipeline typically requires the tr...
research
10/05/2019

Keyword Spotter Model for Crop Pest and Disease Monitoring from Community Radio Data

In societies with well developed internet infrastructure, social media i...
research
06/04/2021

Teaching keyword spotters to spot new keywords with limited examples

Learning to recognize new keywords with just a few examples is essential...

Please sign up or login with your details

Forgot password? Click here to reset