q-RBFNN:A Quantum Calculus-based RBF Neural Network

06/02/2021
by   Syed Saiq Hussain, et al.
0

In this research a novel stochastic gradient descent based learning approach for the radial basis function neural networks (RBFNN) is proposed. The proposed method is based on the q-gradient which is also known as Jackson derivative. In contrast to the conventional gradient, which finds the tangent, the q-gradient finds the secant of the function and takes larger steps towards the optimal solution. The proposed q-RBFNN is analyzed for its convergence performance in the context of least square algorithm. In particular, a closed form expression of the Wiener solution is obtained, and stability bounds of the learning rate (step-size) is derived. The analytical results are validated through computer simulation. Additionally, we propose an adaptive technique for the time-varying q-parameter to improve convergence speed with no trade-offs in the steady state performance.

READ FULL TEXT
research
02/20/2019

LOSSGRAD: automatic learning rate in gradient descent

In this paper, we propose a simple, fast and easy to implement algorithm...
research
10/17/2017

Convergence diagnostics for stochastic gradient descent with constant step size

Iterative procedures in stochastic optimization are typically comprised ...
research
12/04/2018

q-LMF: Quantum Calculus-based Least Mean Fourth Algorithm

Channel estimation is an essential part of modern communication systems ...
research
09/29/2018

AdaShift: Decorrelation and Convergence of Adaptive Learning Rate Methods

Adam is shown not being able to converge to the optimal solution in cert...
research
08/07/2019

Quantum Calculus-based Volterra LMS for Nonlinear Channel Estimation

A novel adaptive filtering method called q-Volterra least mean square (q...
research
06/15/2023

MinMax Networks

While much progress has been achieved over the last decades in neuro-ins...
research
08/08/2023

Real-Time Progressive Learning: Mutually Reinforcing Learning and Control with Neural-Network-Based Selective Memory

Memory, as the basis of learning, determines the storage, update and for...

Please sign up or login with your details

Forgot password? Click here to reset