A 14uJ/Decision Keyword Spotting Accelerator with In-SRAM-Computing and On Chip Learning for Customization

05/10/2022
by   Yu-Hsiang Chiang, et al.
0

Keyword spotting has gained popularity as a natural way to interact with consumer devices in recent years. However, because of its always-on nature and the variety of speech, it necessitates a low-power design as well as user customization. This paper describes a low-power, energy-efficient keyword spotting accelerator with SRAM based in-memory computing (IMC) and on-chip learning for user customization. However, IMC is constrained by macro size, limited precision, and non-ideal effects. To address the issues mentioned above, this paper proposes bias compensation and fine-tuning using an IMC-aware model design. Furthermore, because learning with low-precision edge devices results in zero error and gradient values due to quantization, this paper proposes error scaling and small gradient accumulation to achieve the same accuracy as ideal model training. The simulation results show that with user customization, we can recover the accuracy loss from 51.08% to 89.76% with compensation and fine-tuning and further improve to 96.71% with customization. The chip implementation can successfully run the model with only 14uJ per decision. When compared to the state-of-the-art works, the presented design has higher energy efficiency with additional on-chip model customization capabilities for higher accuracy.

READ FULL TEXT

page 1

page 2

page 7

page 8

research
10/21/2020

Ultra-low power on-chip learning of speech commands with phase-change memories

Embedding artificial intelligence at the edge (edge-AI) is an elegant so...
research
11/09/2021

Ultra-Low Power Keyword Spotting at the Edge

Keyword spotting (KWS) has become an indispensable part of many intellig...
research
02/04/2022

A Fast Network Exploration Strategy to Profile Low Energy Consumption for Keyword Spotting

Keyword Spotting nowadays is an integral part of speech-oriented user in...
research
09/09/2020

Hardware Aware Training for Efficient Keyword Spotting on General Purpose and Specialized Hardware

Keyword spotting (KWS) provides a critical user interface for many mobil...
research
03/26/2021

RCT: Resource Constrained Training for Edge AI

Neural networks training on edge terminals is essential for edge AI comp...
research
01/27/2021

Low-Power Audio Keyword Spotting using Tsetlin Machines

The emergence of Artificial Intelligence (AI) driven Keyword Spotting (K...
research
02/24/2018

Privacy Leakages in Approximate Adders

Approximate computing has recently emerged as a promising method to meet...

Please sign up or login with your details

Forgot password? Click here to reset