DeepAI AI Chat
Log In Sign Up

An Overflow/Underflow-Free Fixed-Point Bit-Width Optimization Method for OS-ELM Digital Circuit

by   Mineto Tsukada, et al.
Keio University

Currently there has been increasing demand for real-time training on resource-limited IoT devices such as smart sensors, which realizes standalone online adaptation for streaming data without data transfers to remote servers. OS-ELM (Online Sequential Extreme Learning Machine) has been one of promising neural-network-based online algorithms for on-chip learning because it can perform online training at low computational cost and is easy to implement as a digital circuit. Existing OS-ELM digital circuits employ fixed-point data format and the bit-widths are often manually tuned, however, this may cause overflow or underflow which can lead to unexpected behavior of the circuit. For on-chip learning systems, an overflow/underflow-free design has a great impact since online training is continuously performed and the intervals of intermediate variables will dynamically change as time goes by. In this paper, we propose an overflow/underflow-free bit-width optimization method for fixed-point digital circuits of OS-ELM. Experimental results show that our method realizes overflow/underflow-free OS-ELM digital circuits with 1.0x - 1.5x more area cost compared to the baseline simulation method where overflow or underflow can happen.


Towards Lower Bit Multiplication for Convolutional Neural Network Training

Convolutional Neural Networks (CNNs) have been widely used in many field...

Simplification of the digital representation of the tent map through biased fixed point

Chaotic systems have been investigated in several areas of engineering. ...

Full abstraction for digital circuits

This paper refines the existing axiomatic semantics of digital circuits ...

Memcomputing Numerical Inversion with Self-Organizing Logic Gates

We propose to use Digital Memcomputing Machines (DMMs), implemented with...

The Metastable Behavior of a Schmitt-Trigger

Schmitt-Trigger circuits are the method of choice for converting general...

Implications of Burn-In Stress on NBTI Degradation

Burn-in is accepted as a way to evaluate ageing effects in an accelerate...