Recent Advances in Convolutional Neural Networks

12/22/2015
by   Jiuxiang Gu, et al.
1

In the last few years, deep learning has led to very good performance on a variety of problems, such as visual recognition, speech recognition and natural language processing. Among different types of deep neural networks, convolutional neural networks have been most extensively studied. Leveraging on the rapid growth in the amount of the annotated data and the great improvements in the strengths of graphics processor units, the research on convolutional neural networks has been emerged swiftly and achieved state-of-the-art results on various tasks. In this paper, we provide a broad survey of the recent advances in convolutional neural networks. We detailize the improvements of CNN on different aspects, including layer design, activation function, loss function, regularization, optimization and fast computation. Besides, we also introduce various applications of convolutional neural networks in computer vision, speech and natural language processing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/23/2018

Deep Reinforcement Learning: An Overview

In recent years, a specific machine learning method called deep learning...
research
06/22/2020

Bayesian Neural Networks: An Introduction and Survey

Neural Networks (NNs) have provided state-of-the-art results for many ch...
research
09/14/2018

Deep CNN Frame Interpolation with Lessons Learned from Natural Language Processing

A major area of growth within deep learning has been the study and imple...
research
01/31/2018

A Survey of Recent Advances in Texture Representation

Texture is a fundamental characteristic of many types of images, and tex...
research
01/17/2019

A Survey of the Recent Architectures of Deep Convolutional Neural Networks

Deep Convolutional Neural Networks (CNNs) are a special type of Neural N...
research
04/01/2020

A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects

Convolutional Neural Network (CNN) is one of the most significant networ...
research
01/17/2022

Using Machine Learning Based Models for Personality Recognition

Personality can be defined as the combination of behavior, emotion, moti...

Please sign up or login with your details

Forgot password? Click here to reset