Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic

10/09/2020
by   Sadegh Aliakbarian, et al.
0

Video anticipation is the task of predicting one/multiple future representation(s) given limited, partial observation. This is a challenging task due to the fact that given limited observation, the future representation can be highly ambiguous. Based on the nature of the task, video anticipation can be considered from two viewpoints: the level of details and the level of determinism in the predicted future. In this research, we start from anticipating a coarse representation of a deterministic future and then move towards predicting continuous and fine-grained future representations of a stochastic process. The example of the former is video action anticipation in which we are interested in predicting one action label given a partially observed video and the example of the latter is forecasting multiple diverse continuations of human motion given partially observed one. In particular, in this thesis, we make several contributions to the literature of video anticipation...

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 33

page 42

09/22/2017

A Real-time Action Prediction Framework by Encoding Temporal Evolution

Anticipating future actions is a key component of intelligence, specific...
12/10/2019

Forecasting Future Sequence of Actions to Complete an Activity

Future human action forecasting from partial observations of activities ...
03/09/2022

Part-level Action Parsing via a Pose-guided Coarse-to-Fine Framework

Action recognition from videos, i.e., classifying a video into one of th...
10/30/2017

Stochastic Variational Video Prediction

Predicting the future in real-world settings, particularly from raw sens...
01/28/2021

VAE^2: Preventing Posterior Collapse of Variational Video Predictions in the Wild

Predicting future frames of video sequences is challenging due to the co...
01/01/2021

Learning the Predictability of the Future

We introduce a framework for learning from unlabeled video what is predi...
05/05/2017

Motion Prediction Under Multimodality with Conditional Stochastic Networks

Given a visual history, multiple future outcomes for a video scene are e...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.