A Tutorial about Random Neural Networks in Supervised Learning

09/15/2016
by   Sebastián Basterrech, et al.
0

Random Neural Networks (RNNs) are a class of Neural Networks (NNs) that can also be seen as a specific type of queuing network. They have been successfully used in several domains during the last 25 years, as queuing networks to analyze the performance of resource sharing in many engineering areas, as learning tools and in combinatorial optimization, where they are seen as neural systems, and also as models of neurological aspects of living beings. In this article we focus on their learning capabilities, and more specifically, we present a practical guide for using the RNN to solve supervised learning problems. We give a general description of these models using almost indistinctly the terminology of Queuing Theory and the neural one. We present the standard learning procedures used by RNNs, adapted from similar well-established improvements in the standard NN field. We describe in particular a set of learning algorithms covering techniques based on the use of first order and, then, of second order derivatives. We also discuss some issues related to these objects and present new perspectives about their use in supervised learning problems. The tutorial describes their most relevant applications, and also provides a large bibliography.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2023

Incorporating Unlabelled Data into Bayesian Neural Networks

We develop a contrastive framework for learning better prior distributio...
research
11/29/2018

A snapshot on nonstandard supervised learning problems: taxonomy, relationships and methods

Machine learning is a field which studies how machines can alter and ada...
research
07/23/2022

Annealed Training for Combinatorial Optimization on Graphs

The hardness of combinatorial optimization (CO) problems hinders collect...
research
03/09/2023

Fredholm integral equations for function approximation and the training of neural networks

We present a novel and mathematically transparent approach to function a...
research
07/05/2021

Uso de GSO cooperativos com decaimentos de pesos para otimizacao de redes neurais

Training of Artificial Neural Networks is a complex task of great import...
research
10/30/2017

A Supervised STDP-based Training Algorithm for Living Neural Networks

Neural networks have shown great potential in many applications like spe...
research
01/30/2019

Ensemble-based kernel learning for a class of data assimilation problems with imperfect forward simulators

Simulator imperfection, often known as model error, is ubiquitous in pra...

Please sign up or login with your details

Forgot password? Click here to reset