The RNN-ELM Classifier

09/25/2016
by   Athanasios Vlontzos, et al.
0

In this paper we examine learning methods combining the Random Neural Network, a biologically inspired neural network and the Extreme Learning Machine that achieve state of the art classification performance while requiring much shorter training time. The Random Neural Network is a integrate and fire computational model of a neural network whose mathematical structure permits the efficient analysis of large ensembles of neurons. An activation function is derived from the RNN and used in an Extreme Learning Machine. We compare the performance of this combination against the ELM with various activation functions, we reduce the input dimensionality via PCA and compare its performance vs. autoencoder based versions of the RNN-ELM.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/07/2021

Biologically Inspired Oscillating Activation Functions Can Bridge the Performance Gap between Biological and Artificial Neurons

Nonlinear activation functions endow neural networks with the ability to...
research
02/08/2019

A simple and efficient architecture for trainable activation functions

Learning automatically the best activation function for the task is an a...
research
10/08/2018

Deep Learning with the Random Neural Network and its Applications

The random neural network (RNN) is a mathematical model for an "integrat...
research
02/11/2008

Extreme Learning Machine for land cover classification

This paper explores the potential of extreme learning machine based supe...
research
03/14/2021

A Modified Batch Intrinsic Plasticity Method for Pre-training the Random Coefficients of Extreme Learning Machines

In extreme learning machines (ELM) the hidden-layer coefficients are ran...
research
06/11/2021

Piecewise-constant Neural ODEs

Neural networks are a popular tool for modeling sequential data but they...
research
10/31/2018

Adaptive Extreme Learning Machine for Recurrent Beta-basis Function Neural Network Training

Beta Basis Function Neural Network (BBFNN) is a special kind of kernel b...

Please sign up or login with your details

Forgot password? Click here to reset