Hello Edge: Keyword Spotting on Microcontrollers

11/20/2017
by   Yundong Zhang, et al.
0

Keyword spotting (KWS) is a critical component for enabling speech based user interactions on smart devices. It requires real-time response and high accuracy for good user experience. Recently, neural networks have become an attractive choice for KWS architecture because of their superior accuracy compared to traditional speech processing algorithms. Due to its always-on nature, KWS application has highly constrained power budget and typically runs on tiny microcontrollers with limited memory and compute capability. The design of neural network architecture for KWS must consider these constraints. In this work, we perform neural network architecture evaluation and exploration for running KWS on resource-constrained microcontrollers. We train various neural network architectures for keyword spotting published in literature to compare their accuracy and memory/compute requirements. We show that it is possible to optimize these neural network architectures to fit within the memory and compute constraints of microcontrollers without sacrificing accuracy. We further explore the depthwise separable convolutional neural network (DS-CNN) and compare it against other neural network architectures. DS-CNN achieves an accuracy of 95.4 of parameters.

READ FULL TEXT
research
11/05/2019

Small-Footprint Keyword Spotting on Raw Audio Data with Sinc-Convolutions

Keyword Spotting (KWS) enables speech-based user interaction on smart de...
research
11/18/2021

A Modular 1D-CNN Architecture for Real-time Digital Pre-distortion

This study reports a novel hardware-friendly modular architecture for im...
research
10/27/2021

Binarized ResNet: Enabling Automatic Modulation Classification at the resource-constrained Edge

In this paper, we propose a ResNet based neural architecture to solve th...
research
04/19/2020

HCM: Hardware-Aware Complexity Metric for Neural Network Architectures

Convolutional Neural Networks (CNNs) have become common in many fields i...
research
01/17/2019

NeuNetS: An Automated Synthesis Engine for Neural Network Design

Application of neural networks to a vast variety of practical applicatio...
research
11/06/2018

Hierarchical Neural Network Architecture In Keyword Spotting

Keyword Spotting (KWS) provides the start signal of ASR problem, and thu...
research
01/12/2018

Not All Ops Are Created Equal!

Efficient and compact neural network models are essential for enabling t...

Please sign up or login with your details

Forgot password? Click here to reset