Extreme Learning Machine with Local Connections

01/22/2018
by   Sibo Yang, et al.
0

This paper is concerned with the sparsification of the input-hidden weights of ELM (Extreme Learning Machine). For ordinary feedforward neural networks, the sparsification is usually done by introducing certain regularization technique into the learning process of the network. But this strategy can not be applied for ELM, since the input-hidden weights of ELM are supposed to be randomly chosen rather than to be learned. To this end, we propose a modified ELM, called ELM-LC (ELM with local connections), which is designed for the sparsification of the input-hidden weights as follows: The hidden nodes and the input nodes are divided respectively into several corresponding groups, and an input node group is fully connected with its corresponding hidden node group, but is not connected with any other hidden node group. As in the usual ELM, the hidden-input weights are randomly given, and the hidden-output weights are obtained through a least square learning. In the numerical simulations on some benchmark problems, the new ELM-CL behaves better than the traditional ELM.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2017

Restricted Boltzmann machine to determine the input weights for extreme learning machines

The Extreme Learning Machine (ELM) is a single-hidden layer feedforward ...
research
07/24/2019

Backward-Forward Algorithm: An Improvement towards Extreme Learning Machine

Extreme learning machine (ELM), a randomized learning paradigm for a sin...
research
09/13/2014

A study on effectiveness of extreme learning machine

Extreme learning machine (ELM), proposed by Huang et al., has been shown...
research
02/01/2018

A Modified Sigma-Pi-Sigma Neural Network with Adaptive Choice of Multinomials

Sigma-Pi-Sigma neural networks (SPSNNs) as a kind of high-order neural n...
research
04/13/2005

A Learning Algorithm for Evolving Cascade Neural Networks

A new learning algorithm for Evolving Cascade Neural Networks (ECNNs) is...
research
11/22/2018

Conditioning Optimization of Extreme Learning Machine by Multitask Beetle Antennae Swarm Algorithm

Extreme learning machine (ELM) as a simple and rapid neural network has ...
research
08/09/2014

RMSE-ELM: Recursive Model based Selective Ensemble of Extreme Learning Machines for Robustness Improvement

Extreme learning machine (ELM) as an emerging branch of shallow networks...

Please sign up or login with your details

Forgot password? Click here to reset