Learning to Linearize Under Uncertainty

06/09/2015
by   Ross Goroshin, et al.
0

Training deep feature hierarchies to solve supervised learning tasks has achieved state of the art performance on many problems in computer vision. However, a principled way in which to train such hierarchies in the unsupervised setting has remained elusive. In this work we suggest a new architecture and loss for training deep feature hierarchies that linearize the transformations observed in unlabeled natural video sequences. This is done by training a generative model to predict video frames. We also address the problem of inherent uncertainty in prediction by introducing latent variables that are non-deterministic functions of the input into the network architecture.

READ FULL TEXT

page 7

page 8

research
11/01/2018

Neural Rendering Model: Joint Generation and Prediction for Semi-Supervised Learning

Unsupervised and semi-supervised learning are important problems that ar...
research
05/25/2016

Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning

While great strides have been made in using deep learning algorithms to ...
research
05/20/2020

Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation

Supervised learning in large discriminative models is a mainstay for mod...
research
05/20/2020

Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation

Supervised learning in large discriminative models is a mainstay for mod...
research
10/07/2018

Principled Deep Neural Network Training through Linear Programming

Deep Learning has received significant attention due to its impressive p...
research
09/03/2021

Topographic VAEs learn Equivariant Capsules

In this work we seek to bridge the concepts of topographic organization ...
research
11/02/2020

Adversarial training for predictive tasks: theoretical analysis and limitations in the deterministic case

To train a deep neural network to mimic the outcomes of processing seque...

Please sign up or login with your details

Forgot password? Click here to reset