Restricted Boltzmann machine to determine the input weights for extreme learning machines

08/17/2017
by   Andre Pacheco, et al.
0

The Extreme Learning Machine (ELM) is a single-hidden layer feedforward neural network (SLFN) learning algorithm that can learn effectively and quickly. The ELM training phase assigns the input weights and bias randomly and does not change them in the whole process. Although the network works well, the random weights in the input layer can make the algorithm less effective and impact on its performance. Therefore, we propose a new approach to determine the input weights and bias for the ELM using the restricted Boltzmann machine (RBM), which we call RBM-ELM. We compare our new approach with a well-known approach to improve the ELM and a state of the art algorithm to select the weights for the ELM. The results show that the RBM-ELM outperforms both methodologies and achieve a better performance than the ELM.

READ FULL TEXT
research
09/13/2014

A study on effectiveness of extreme learning machine

Extreme learning machine (ELM), proposed by Huang et al., has been shown...
research
01/22/2018

Extreme Learning Machine with Local Connections

This paper is concerned with the sparsification of the input-hidden weig...
research
10/27/2022

Multi-layered Discriminative Restricted Boltzmann Machine with Untrained Probabilistic Layer

An extreme learning machine (ELM) is a three-layered feed-forward neural...
research
06/02/2023

MLP-Mixer as a Wide and Sparse MLP

Multi-layer perceptron (MLP) is a fundamental component of deep learning...
research
11/22/2018

Conditioning Optimization of Extreme Learning Machine by Multitask Beetle Antennae Swarm Algorithm

Extreme learning machine (ELM) as a simple and rapid neural network has ...
research
08/25/2015

An analysis of numerical issues in neural training by pseudoinversion

Some novel strategies have recently been proposed for single hidden laye...
research
06/24/2017

Temporal-related Convolutional-Restricted-Boltzmann-Machine capable of learning relational order via reinforcement learning procedure?

In this article, we extend the conventional framework of convolutional-R...

Please sign up or login with your details

Forgot password? Click here to reset