An Overflow/Underflow-Free Fixed-Point Bit-Width Optimization Method for OS-ELM Digital Circuit

03/17/2021
by   Mineto Tsukada, et al.
0

Currently there has been increasing demand for real-time training on resource-limited IoT devices such as smart sensors, which realizes standalone online adaptation for streaming data without data transfers to remote servers. OS-ELM (Online Sequential Extreme Learning Machine) has been one of promising neural-network-based online algorithms for on-chip learning because it can perform online training at low computational cost and is easy to implement as a digital circuit. Existing OS-ELM digital circuits employ fixed-point data format and the bit-widths are often manually tuned, however, this may cause overflow or underflow which can lead to unexpected behavior of the circuit. For on-chip learning systems, an overflow/underflow-free design has a great impact since online training is continuously performed and the intervals of intermediate variables will dynamically change as time goes by. In this paper, we propose an overflow/underflow-free bit-width optimization method for fixed-point digital circuits of OS-ELM. Experimental results show that our method realizes overflow/underflow-free OS-ELM digital circuits with 1.0x - 1.5x more area cost compared to the baseline simulation method where overflow or underflow can happen.

READ FULL TEXT
research
06/04/2020

Towards Lower Bit Multiplication for Convolutional Neural Network Training

Convolutional Neural Networks (CNNs) have been widely used in many field...
research
10/14/2019

Simplification of the digital representation of the tent map through biased fixed point

Chaotic systems have been investigated in several areas of engineering. ...
research
01/25/2022

Full abstraction for digital circuits

This paper refines the existing axiomatic semantics of digital circuits ...
research
11/28/2017

An Overflow Free Fixed-point Eigenvalue Decomposition Algorithm: Case Study of Dimensionality Reduction in Hyperspectral Images

We consider the problem of enabling robust range estimation of eigenvalu...
research
12/13/2016

Memcomputing Numerical Inversion with Self-Organizing Logic Gates

We propose to use Digital Memcomputing Machines (DMMs), implemented with...
research
06/15/2020

The Metastable Behavior of a Schmitt-Trigger

Schmitt-Trigger circuits are the method of choice for converting general...
research
07/22/2019

Reconfigurable multiplier architecture based on memristor-cmos with higher flexibility

Multiplication is an indispensable operation in most of digital signal p...

Please sign up or login with your details

Forgot password? Click here to reset