A Vest of the Pseudoinverse Learning Algorithm

05/20/2018
by   Ping Guo, et al.
0

In this letter, we briefly review the basic scheme of the pseudoinverse learning (PIL) algorithm and present some discussions on the PIL, as well as its variants. The PIL algorithm, first presented in 1995, is a non-gradient descent algorithm for multi-layer neural networks and has several advantages compared with gradient descent based algorithms. We also show that the so-called extreme learning machine (ELM) is a vest (another name) of the PIL algorithm for single hidden layer feedforward neural networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/05/2018

PILAE: A Non-gradient Descent Learning Scheme for Deep Feedforward Neural Networks

In this work, a non-gradient descent learning scheme is proposed for dee...
research
12/09/2016

Learning Representations by Stochastic Meta-Gradient Descent in Neural Networks

Representations are fundamental to artificial intelligence. The performa...
research
08/30/2019

High-Fidelity State-of-Charge Estimation of Li-Ion Batteries Using Machine Learning

This paper proposes a way to augment the existing machine learning algor...
research
05/26/2023

Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks

Recently, significant progress has been made in understanding the genera...
research
12/08/2014

Provable Methods for Training Neural Networks with Sparse Connectivity

We provide novel guaranteed approaches for training feedforward neural n...
research
06/13/2019

Empowering swarm-based optimizers by multi-scale search to enhance Gradient Descent initialization performance

Swarm-based optimizers like Particle Swarm Optimization or Imperialistic...
research
05/22/2018

Parsimonious Bayesian deep networks

Combining Bayesian nonparametrics and a forward model selection strategy...

Please sign up or login with your details

Forgot password? Click here to reset