Dense Optical Flow Prediction from a Static Image

05/02/2015
by   Jacob Walker, et al.
0

Given a scene, what is going to move, and in what direction will it move? Such a question could be considered a non-semantic form of action prediction. In this work, we present a convolutional neural network (CNN) based approach for motion prediction. Given a static image, this CNN predicts the future motion of each and every pixel in the image in terms of optical flow. Our CNN model leverages the data in tens of thousands of realistic videos to train our model. Our method relies on absolutely no human labeling and is able to predict motion based on the context of the scene. Because our CNN model makes no assumptions about the underlying scene, it can predict future optical flow on a diverse set of scenarios. We outperform all previous approaches by large margins.

READ FULL TEXT

page 1

page 3

page 5

page 8

research
11/09/2017

Predicting Scene Parsing and Motion Dynamics in the Future

The ability of predicting the future is important for intelligent system...
research
06/14/2018

Learning Human Optical Flow

The optical flow of humans is well known to be useful for the analysis o...
research
02/08/2022

Learning Optical Flow with Adaptive Graph Reasoning

Estimating per-pixel motion between video frames, known as optical flow,...
research
07/12/2021

DDCNet-Multires: Effective Receptive Field Guided Multiresolution CNN for Dense Prediction

Dense optical flow estimation is challenging when there are large displa...
research
06/25/2016

An Uncertain Future: Forecasting from Static Images using Variational Autoencoders

In a given scene, humans can often easily predict a set of immediate fut...
research
04/02/2020

Learning to See Through Obstructions

We present a learning-based approach for removing unwanted obstructions,...
research
01/29/2019

Visual Rhythm Prediction with Feature-Aligning Network

In this paper, we propose a data-driven visual rhythm prediction method,...

Please sign up or login with your details

Forgot password? Click here to reset