Attention-based End-to-End Models for Small-Footprint Keyword Spotting

03/29/2018
by   Changhao Shan, et al.
0

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an attention mechanism. The encoder transforms the input signal into a high level representation using RNNs. Then the attention mechanism weights the encoder features and generates a fixed-length vector. Finally, by linear transformation and softmax function, the vector becomes a score used for keyword detection. We also evaluate the performance of different encoder architectures, including LSTM, GRU and CRNN. Experiments on real-world wake-up data show that our approach outperforms the recent Deep KWS approach by a large margin and the best performance is achieved by CRNN. To be more specific, with 84K parameters, our attention-based model achieves 1.02 (FRR) at 1.0 false alarm (FA) per hour.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2018

Sequence-to-sequence Models for Small-Footprint Keyword Spotting

In this paper, we propose a sequence-to-sequence model for keyword spott...
research
09/16/2016

Image-to-Markup Generation with Coarse-to-Fine Attention

We present a neural encoder-decoder model to convert images into present...
research
11/01/2018

End-to-end Models with auditory attention in Multi-channel Keyword Spotting

In this paper, we propose an attention-based end-to-end model for multi-...
research
09/01/2021

A Separable Temporal Convolution Neural Network with Attention for Small-Footprint Keyword Spotting

Keyword spotting (KWS) on mobile devices generally requires a small memo...
research
10/10/2019

Orthogonality Constrained Multi-Head Attention For Keyword Spotting

Multi-head attention mechanism is capable of learning various representa...
research
10/11/2022

LARF: Two-level Attention-based Random Forests with a Mixture of Contamination Models

New models of the attention-based random forests called LARF (Leaf Atten...
research
06/29/2021

Attention Aware Wavelet-based Detection of Morphed Face Images

Morphed images have exploited loopholes in the face recognition checkpoi...

Please sign up or login with your details

Forgot password? Click here to reset