On the Implementation of Fixed-point Exponential Function for Machine Learning and Signal Processing Accelerators

12/04/2021
by   Mahesh Chandra, et al.
0

The natural exponential function is widely used in modeling many engineering and scientific systems. It is also an integral part of many neural network activation function such as sigmoid, tanh, ELU, RBF etc. Dedicated hardware accelerator and processors are designed for faster execution of such applications. Such accelerators can immensely benefit from an optimal implementation of exponential function. This can be achieved for most applications with the knowledge that the exponential function for a negative domain is more widely used than the positive domain. This paper presents an optimized implementation of exponential function for variable precision fixed point negative input. The implementation presented here significantly reduces the number of multipliers and adders. This is further optimized using mixed world-length implementation for the series expansion. The reduction in area and power consumption is more than 30 equivalent method.

READ FULL TEXT
research
07/27/2020

A Novel Method for Scalable VLSI Implementation of Hyperbolic Tangent Function

Hyperbolic tangent and Sigmoid functions are used as non-linear activati...
research
07/13/2020

Hardware Implementation of Hyperbolic Tangent Function using Catmull-Rom Spline Interpolation

Deep neural networks yield the state of the art results in many computer...
research
07/13/2020

Comparative Analysis of Polynomial and Rational Approximations of Hyperbolic Tangent Function for VLSI Implementation

Deep neural networks yield the state-of-the-art results in many computer...
research
09/22/2018

Design Space Exploration of Neural Network Activation Function Circuits

The widespread application of artificial neural networks has prompted re...
research
06/01/2017

Dynamic Stripes: Exploiting the Dynamic Precision Requirements of Activation Values in Neural Networks

Stripes is a Deep Neural Network (DNN) accelerator that uses bit-serial ...
research
08/29/2019

Survey and Benchmarking of Machine Learning Accelerators

Advances in multicore processors and accelerators have opened the flood ...
research
06/12/2020

SemifreddoNets: Partially Frozen Neural Networks for Efficient Computer Vision Systems

We propose a system comprised of fixed-topology neural networks having p...

Please sign up or login with your details

Forgot password? Click here to reset