When will you do what? - Anticipating Temporal Occurrences of Activities

04/03/2018
by   Yazan Abu Farha, et al.
0

Analyzing human actions in videos has gained increased attention recently. While most works focus on classifying and labeling observed video frames or anticipating the very recent future, making long-term predictions over more than just a few seconds is a task with many practical applications that has not yet been addressed. In this paper, we propose two methods to predict a considerably large amount of future actions and their durations. Both, a CNN and an RNN are trained to learn future video labels based on previously seen content. We show that our methods generate accurate predictions of the future even for long videos with a huge amount of different actions and can even deal with noisy or erroneous input information.

READ FULL TEXT
research
05/27/2022

Future Transformer for Long-term Action Anticipation

The task of predicting future actions from a video is crucial for a real...
research
04/16/2019

Long-Term Video Generation of Multiple FuturesUsing Human Poses

Predicting the near-future from an input video is a useful task for appl...
research
04/16/2019

Long-Term Video Generation of Multiple Futures Using Human Poses

Predicting the near-future from an input video is a useful task for appl...
research
08/26/2019

Uncertainty-Aware Anticipation of Activities

Anticipating future activities in video is a task with many practical ap...
research
01/13/2021

Learning to Anticipate Egocentric Actions by Imagination

Anticipating actions before they are executed is crucial for a wide rang...
research
08/13/2019

Predicting 3D Human Dynamics from Video

Given a video of a person in action, we can easily guess the 3D future m...
research
09/02/2020

Long-Term Anticipation of Activities with Cycle Consistency

With the success of deep learning methods in analyzing activities in vid...

Please sign up or login with your details

Forgot password? Click here to reset