A study on effectiveness of extreme learning machine

09/13/2014
by   Yuguang Wang, et al.
0

Extreme learning machine (ELM), proposed by Huang et al., has been shown a promising learning algorithm for single-hidden layer feedforward neural networks (SLFNs). Nevertheless, because of the random choice of input weights and biases, the ELM algorithm sometimes makes the hidden layer output matrix H of SLFN not full column rank, which lowers the effectiveness of ELM. This paper discusses the effectiveness of ELM and proposes an improved algorithm called EELM that makes a proper selection of the input weights and bias before calculating the output weights, which ensures the full column rank of H in theory. This improves to some extend the learning rate (testing accuracy, prediction accuracy, learning time) and the robustness property of the networks. The experimental results based on both the benchmark function approximation and real-world problems including classification and regression applications show the good performances of EELM.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/22/2018

Conditioning Optimization of Extreme Learning Machine by Multitask Beetle Antennae Swarm Algorithm

Extreme learning machine (ELM) as a simple and rapid neural network has ...
research
08/17/2017

Restricted Boltzmann machine to determine the input weights for extreme learning machines

The Extreme Learning Machine (ELM) is a single-hidden layer feedforward ...
research
10/30/2017

Rough extreme learning machine: a new classification method based on uncertainty measure

Extreme learning machine (ELM) is a new single hidden layer feedback neu...
research
01/22/2018

Extreme Learning Machine with Local Connections

This paper is concerned with the sparsification of the input-hidden weig...
research
05/26/2022

Orthogonal Stochastic Configuration Networks with Adaptive Construction Parameter for Data Analytics

As a randomized learner model, SCNs are remarkable that the random weigh...
research
11/04/2020

Rank Based Pseudoinverse Computation in Extreme Learning Machine for Large Datasets

Extreme Learning Machine (ELM) is an efficient and effective least-squar...
research
02/07/2021

An Analytic Layer-wise Deep Learning Framework with Applications to Robotics

Deep learning has achieved great success in many applications, but it ha...

Please sign up or login with your details

Forgot password? Click here to reset