General Backpropagation Algorithm for Training Second-order Neural Networks

08/17/2017
by   Fenglei Fan, et al.
0

The artificial neural network is a popular framework in machine learning. To empower individual neurons, we recently suggested that the current type of neurons could be upgraded to 2nd order counterparts, in which the linear operation between inputs to a neuron and the associated weights is replaced with a nonlinear quadratic operation. A single 2nd order neurons already has a strong nonlinear modeling ability, such as implementing basic fuzzy logic operations. In this paper, we develop a general backpropagation (BP) algorithm to train the network consisting of 2nd-order neurons. The numerical studies are performed to verify of the generalized BP algorithm.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
07/04/2018

Fuzzy Logic Interpretation of Artificial Neural Networks

Over past several years, deep learning has achieved huge successes in va...
research
04/26/2017

A New Type of Neurons for Machine Learning

In machine learning, the use of an artificial neural network is the main...
research
04/21/2014

Influence of the learning method in the performance of feedforward neural networks when the activity of neurons is modified

A method that allows us to give a different treatment to any neuron insi...
research
08/27/2023

Slimmed optical neural networks with multiplexed neuron sets and a corresponding backpropagation training algorithm

Due to their intrinsic capabilities on parallel signal processing, optic...
research
11/02/2016

Natural-Parameter Networks: A Class of Probabilistic Neural Networks

Neural networks (NN) have achieved state-of-the-art performance in vario...
research
10/12/2021

Expressivity and Trainability of Quadratic Networks

Inspired by diversity of biological neurons, quadratic artificial neuron...
research
05/19/2018

Neural networks with dynamical coefficients and adjustable connections on the basis of integrated backpropagation

We consider artificial neurons which will update their weight coefficien...

Please sign up or login with your details

Forgot password? Click here to reset