Prediction Under Uncertainty with Error-Encoding Networks

11/14/2017
by   Mikael Henaff, et al.
0

In this work we introduce a new framework for performing temporal predictions in the presence of uncertainty. It is based on a simple idea of disentangling components of the future state which are predictable from those which are inherently unpredictable, and encoding the unpredictable components into a low-dimensional latent variable which is fed into a forward model. Our method uses a supervised training objective which is fast and easy to train. We evaluate it in the context of video prediction on multiple datasets and show that it is able to consistently generate diverse predictions without the need for alternating minimization over a latent space or adversarial training.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
03/21/2018

Probabilistic Video Generation using Holistic Attribute Control

Videos express highly structured spatio-temporal patterns of visual data...
research
05/04/2022

Zero-Episode Few-Shot Contrastive Predictive Coding: Solving intelligence tests without prior training

Video prediction models often combine three components: an encoder from ...
research
05/18/2023

Uncertainty Quantification in Deep Neural Networks through Statistical Inference on Latent Space

Uncertainty-quantification methods are applied to estimate the confidenc...
research
10/14/2020

Back to the Future: Cycle Encoding Prediction for Self-supervised Contrastive Video Representation Learning

In this paper we show that learning video feature spaces in which tempor...
research
04/04/2018

Stochastic Adversarial Video Prediction

Being able to predict what may happen in the future requires an in-depth...
research
07/16/2021

CCVS: Context-aware Controllable Video Synthesis

This presentation introduces a self-supervised learning approach to the ...
research
03/25/2022

StretchBEV: Stretching Future Instance Prediction Spatially and Temporally

In self-driving, predicting future in terms of location and motion of al...

Please sign up or login with your details

Forgot password? Click here to reset