Deep Learning in Neural Networks: An Overview

04/30/2014
by   Juergen Schmidhuber, et al.
0

In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2022

Annotated History of Modern AI and Deep Learning

Machine learning is the science of credit assignment: finding patterns i...
research
06/27/2021

Use of Machine Learning Technique to maximize the signal over background for H → ττ

In recent years, artificial neural networks (ANNs) have won numerous con...
research
06/23/2018

Deep Reinforcement Learning: An Overview

In recent years, a specific machine learning method called deep learning...
research
04/07/2020

From Artificial Neural Networks to Deep Learning for Music Generation – History, Concepts and Trends

The current tsunami of deep learning (the hyper-vitamined return of arti...
research
02/24/2017

On the Origin of Deep Learning

This paper is a review of the evolutionary history of deep learning mode...
research
11/07/2022

Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy

In recent years, deep learning has infiltrated every field it has touche...
research
08/15/2021

Pattern Inversion as a Pattern Recognition Method for Machine Learning

Artificial neural networks use a lot of coefficients that take a great d...

Please sign up or login with your details

Forgot password? Click here to reset