A Separable Temporal Convolution Neural Network with Attention for Small-Footprint Keyword Spotting

09/01/2021
by   Shenghua Hu, et al.
0

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. To solve this problem, this paper proposes a separable temporal convolution neural network with attention, it has a small number of parameters. Through the time convolution combined with attention mechanism, a small number of parameters model (32.2K) is implemented while maintaining high performance. The proposed model achieves 95.7 on the Google Speech Commands dataset, which is close to the performance of Res15(239K), the state-of-the-art model in KWS at present.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/27/2021

Separable Temporal Convolution plus Temporally Pooled Attention for Lightweight High-performance Keyword Spotting

Keyword spotting (KWS) on mobile devices generally requires a small memo...
research
04/25/2020

Depthwise Separable Convolutional ResNet with Squeeze-and-Excitation Blocks for Small-footprint Keyword Spotting

One difficult problem of keyword spotting is how to miniaturize its memo...
research
08/01/2020

Neural ODE with Temporal Convolution and Time Delay Neural Networks for Small-Footprint Keyword Spotting

In this paper, we propose neural network models based on the neural ordi...
research
10/20/2020

Small-Footprint Keyword Spotting with Multi-Scale Temporal Convolution

Keyword Spotting (KWS) plays a vital role in human-computer interaction ...
research
10/30/2017

An Experimental Analysis of the Power Consumption of Convolutional Neural Networks for Keyword Spotting

Nearly all previous work on small-footprint keyword spotting with neural...
research
09/12/2017

Small-footprint Keyword Spotting Using Deep Neural Network and Connectionist Temporal Classifier

Mainly for the sake of solving the lack of keyword-specific data, we pro...
research
03/29/2018

Attention-based End-to-End Models for Small-Footprint Keyword Spotting

In this paper, we propose an attention-based end-to-end neural approach ...

Please sign up or login with your details

Forgot password? Click here to reset