Semi-Supervised Learning with Ladder Networks

07/09/2015
by   Antti Rasmus, et al.
0

We combine supervised learning with unsupervised learning in deep neural networks. The proposed model is trained to simultaneously minimize the sum of supervised and unsupervised cost functions by backpropagation, avoiding the need for layer-wise pre-training. Our work builds on the Ladder network proposed by Valpola (2015), which we extend by combining the model with supervision. We show that the resulting model reaches state-of-the-art performance in semi-supervised MNIST and CIFAR-10 classification, in addition to permutation-invariant MNIST classification with all labels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/30/2015

Lateral Connections in Denoising Autoencoders Support Supervised Learning

We show how a deep denoising autoencoder with lateral connections can be...
research
11/14/2016

Deep Learning with Sets and Point Clouds

We introduce a simple permutation equivariant layer for deep learning wi...
research
11/07/2016

Adversarial Ladder Networks

The use of unsupervised data in addition to supervised data in training ...
research
02/26/2020

A Comprehensive Approach to Unsupervised Embedding Learning based on AND Algorithm

Unsupervised embedding learning aims to extract good representation from...
research
10/27/2018

Convolutional neural networks with extra-classical receptive fields

Convolutional neural networks (CNNs) have had great success in many real...
research
12/04/2020

Rethinking supervised learning: insights from biological learning and from calling it by its name

The renaissance of artificial neural networks was catalysed by the succe...
research
10/28/2018

Semi-Supervised Translation with MMD Networks

This work aims to improve semi-supervised learning in a neural network a...

Please sign up or login with your details

Forgot password? Click here to reset