JavaScript Convolutional Neural Networks for Keyword Spotting in the Browser: An Experimental Analysis

10/30/2018
by   Jaejun Lee, et al.
0

Used for simple commands recognition on devices from smart routers to mobile phones, keyword spotting systems are everywhere. Ubiquitous as well are web applications, which have grown in popularity and complexity over the last decade with significant improvements in usability under cross-platform conditions. However, despite their obvious advantage in natural language interaction, voice-enabled web applications are still far and few between. In this work, we attempt to bridge this gap by bringing keyword spotting capabilities directly into the browser. To our knowledge, we are the first to demonstrate a fully-functional implementation of convolutional neural networks in pure JavaScript that runs in any standards-compliant browser. We also apply network slimming, a model compression technique, to explore the accuracy-efficiency tradeoffs, reporting latency measurements on a range of devices and software. Overall, our robust, cross-device implementation for keyword spotting realizes a new paradigm for serving neural network applications, and one of our slim models reduces latency by 66 decrease in accuracy of 4

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
12/16/2019

Predicting detection filters for small footprint open-vocabulary keyword spotting

In many scenarios, detecting keywords from natural language queries is s...
research
07/19/2016

Trainable Frontend For Robust and Far-Field Keyword Spotting

Robust and far-field speech recognition is critical to enable true hands...
research
10/18/2017

Honk: A PyTorch Reimplementation of Convolutional Neural Networks for Keyword Spotting

We describe Honk, an open-source PyTorch reimplementation of convolution...
research
08/09/2020

Accurate Detection of Wake Word Start and End Using a CNN

Small footprint embedded devices require keyword spotters (KWS) with sma...
research
01/10/2022

Sub-mW Keyword Spotting on an MCU: Analog Binary Feature Extraction and Binary Neural Networks

Keyword spotting (KWS) is a crucial function enabling the interaction wi...
research
06/15/2022

Latency Control for Keyword Spotting

Conversational agents commonly utilize keyword spotting (KWS) to initiat...
research
09/12/2019

A Channel-Pruned and Weight-Binarized Convolutional Neural Network for Keyword Spotting

We study channel number reduction in combination with weight binarizatio...

Please sign up or login with your details

Forgot password? Click here to reset