Deja Vu: Motion Prediction in Static Images

03/19/2018
by   Silvia L. Pintea, et al.
0

This paper proposes motion prediction in single still images by learning it from a set of videos. The building assumption is that similar motion is characterized by similar appearance. The proposed method learns local motion patterns given a specific appearance and adds the predicted motion in a number of applications. This work (i) introduces a novel method to predict motion from appearance in a single static image, (ii) to that end, extends of the Structured Random Forest with regression derived from first principles, and (iii) shows the value of adding motion predictions in different tasks such as: weak frame-proposals containing unexpected events, action recognition, motion saliency. Illustrative results indicate that motion prediction is not only feasible, but also provides valuable information for a number of applications.

READ FULL TEXT

page 7

page 10

page 12

page 13

research
09/06/2016

Making a Case for Learning Motion Representations with Phase

This work advocates Eulerian motion representation learning over the cur...
research
11/23/2022

Dynamic Appearance: A Video Representation for Action Recognition with Joint Training

Static appearance of video may impede the ability of a deep neural netwo...
research
07/13/2022

Is Appearance Free Action Recognition Possible?

Intuition might suggest that motion and dynamic information are key to v...
research
10/27/2022

Learning Joint Representation of Human Motion and Language

In this work, we present MoLang (a Motion-Language connecting model) for...
research
05/12/2017

Single Image Action Recognition by Predicting Space-Time Saliency

We propose a novel approach based on deep Convolutional Neural Networks ...
research
07/07/2018

Video Prediction with Appearance and Motion Conditions

Video prediction aims to generate realistic future frames by learning dy...
research
02/10/2023

Data-Driven Stochastic Motion Evaluation and Optimization with Image by Spatially-Aligned Temporal Encoding

This paper proposes a probabilistic motion prediction method for long mo...

Please sign up or login with your details

Forgot password? Click here to reset