A Tutorial on Deep Neural Networks for Intelligent Systems

03/23/2016
by   Juan C. Cuevas-Tello, et al.
0

Developing Intelligent Systems involves artificial intelligence approaches including artificial neural networks. Here, we present a tutorial of Deep Neural Networks (DNNs), and some insights about the origin of the term "deep"; references to deep learning are also given. Restricted Boltzmann Machines, which are the core of DNNs, are discussed in detail. An example of a simple two-layer network, performing unsupervised learning for unlabeled data, is shown. Deep Belief Networks (DBNs), which are used to build networks with more than two layers, are also described. Moreover, examples for supervised learning with DNNs performing simple prediction and classification tasks, are presented and explained. This tutorial includes two intelligent pattern recognition applications: hand- written digits (benchmark known as MNIST) and speech recognition.

READ FULL TEXT
research
05/07/2005

Visual Character Recognition using Artificial Neural Networks

The recognition of optical characters is known to be one of the earliest...
research
10/13/2018

Mixture of Expert/Imitator Networks: Scalable Semi-supervised Learning Framework

The current success of deep neural networks (DNNs) in an increasingly br...
research
08/15/2016

Regularization for Unsupervised Deep Neural Nets

Unsupervised neural networks, such as restricted Boltzmann machines (RBM...
research
08/05/2018

Model-Aided Wireless Artificial Intelligence: Embedding Expert Knowledge in Deep Neural Networks Towards Wireless Systems Optimization

Deep learning based on artificial neural networks is a powerful machine ...
research
11/30/2020

Monadic Pavlovian associative learning in a backpropagation-free photonic network

Over a century ago, Ivan P. Pavlov, in a classic experiment, demonstrate...
research
06/30/2019

Mechanisms of Artistic Creativity in Deep Learning Neural Networks

The generative capabilities of deep learning neural networks (DNNs) have...
research
04/26/2015

Comparison of Training Methods for Deep Neural Networks

This report describes the difficulties of training neural networks and i...

Please sign up or login with your details

Forgot password? Click here to reset