A Novel Method for improving accuracy in neural network by reinstating traditional back propagation technique

08/09/2023
by   Gokulprasath R, et al.
0

Deep learning has revolutionized industries like computer vision, natural language processing, and speech recognition. However, back propagation, the main method for training deep neural networks, faces challenges like computational overhead and vanishing gradients. In this paper, we propose a novel instant parameter update methodology that eliminates the need for computing gradients at each layer. Our approach accelerates learning, avoids the vanishing gradient problem, and outperforms state-of-the-art methods on benchmark data sets. This research presents a promising direction for efficient and effective deep neural network training.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/16/2020

Gradient Amplification: An efficient way to train deep neural networks

Improving performance of deep learning models and reducing their trainin...
research
11/14/2015

Efficient Training of Very Deep Neural Networks for Supervised Hashing

In this paper, we propose training very deep neural networks (DNNs) for ...
research
12/10/2017

Gradient Normalization & Depth Based Decay For Deep Learning

In this paper we introduce a novel method of gradient normalization and ...
research
10/22/2019

Vanishing Nodes: Another Phenomenon That Makes Training Deep Neural Networks Difficult

It is well known that the problem of vanishing/exploding gradients is a ...
research
06/17/2020

Constraint-Based Regularization of Neural Networks

We propose a method for efficiently incorporating constraints into a sto...
research
08/02/2017

On the Importance of Consistency in Training Deep Neural Networks

We explain that the difficulties of training deep neural networks come f...
research
07/01/2023

Forward-Forward Algorithm for Hyperspectral Image Classification: A Preliminary Study

The back-propagation algorithm has long been the de-facto standard in op...

Please sign up or login with your details

Forgot password? Click here to reset