A Deep Convolutional Auto-Encoder with Pooling - Unpooling Layers in Caffe

01/18/2017
by   Volodymyr Turchenko, et al.
0

This paper presents the development of several models of a deep convolutional auto-encoder in the Caffe deep learning framework and their experimental evaluation on the example of MNIST dataset. We have created five models of a convolutional auto-encoder which differ architecturally by the presence or absence of pooling and unpooling layers in the auto-encoder's encoder and decoder parts. Our results show that the developed models provide very good results in dimensionality reduction and unsupervised clustering tasks, and small classification errors when we used the learned internal code as an input of a supervised linear classifier and multi-layer perceptron. The best results were provided by a model where the encoder part contains convolutional and pooling layers, followed by an analogous decoder part with deconvolution and unpooling layers without the use of switch variables in the decoder part. The paper also discusses practical details of the creation of a deep convolutional auto-encoder in the very popular Caffe deep learning framework. We believe that our approach and results presented in this paper could help other researchers to build efficient deep neural network architectures in the future.

READ FULL TEXT

page 5

page 6

page 10

page 15

page 16

research
12/04/2015

Creation of a Deep Convolutional Auto-Encoder in Caffe

The development of a deep (stacked) convolutional auto-encoder in the Ca...
research
05/15/2020

An Auto Encoder For Audio Dolphin Communication

Research in dolphin communication and cognition requires detailed inspec...
research
09/20/2017

Updating the silent speech challenge benchmark with deep learning

The 2010 Silent Speech Challenge benchmark is updated with new results o...
research
06/06/2019

FSPool: Learning Set Representations with Featurewise Sort Pooling

We introduce a pooling method for sets of feature vectors based on sorti...
research
02/06/2018

Byte-Level Recursive Convolutional Auto-Encoder for Text

This article proposes to auto-encode text at byte-level using convolutio...

Please sign up or login with your details

Forgot password? Click here to reset