SceneEDNet: A Deep Learning Approach for Scene Flow Estimation

07/10/2018
by   Ravi Kumar Thakur, et al.
0

Estimating scene flow in RGB-D videos is attracting much interest of the computer vision researchers, due to its potential applications in robotics. The state-of-the-art techniques for scene flow estimation, typically rely on the knowledge of scene structure of the frame and the correspondence between frames. However, with the increasing amount of RGB-D data captured from sophisticated sensors like Microsoft Kinect, and the recent advances in the area of sophisticated deep learning techniques, introduction of an efficient deep learning technique for scene flow estimation, is becoming important. This paper introduces a first effort to apply a deep learning method for direct estimation of scene flow by presenting a fully convolutional neural network with an encoder-decoder (ED) architecture. The proposed network SceneEDNet involves estimation of three dimensional motion vectors of all the scene points from sequence of stereo images. The training for direct estimation of scene flow is done using consecutive pairs of stereo images and corresponding scene flow ground truth. The proposed architecture is applied on a huge dataset and provides meaningful results.

READ FULL TEXT

page 1

page 5

research
04/25/2019

A Conditional Adversarial Network for Scene Flow Estimation

The problem of Scene flow estimation in depth videos has been attracting...
research
11/24/2021

MonoPLFlowNet: Permutohedral Lattice FlowNet for Real-Scale 3D Scene FlowEstimation with Monocular Images

Real-scale scene flow estimation has become increasingly important for 3...
research
04/11/2017

Simultaneous Stereo Video Deblurring and Scene Flow Estimation

Videos for outdoor scene often show unpleasant blur effects due to the l...
research
12/08/2016

Scene Flow Estimation: A Survey

This paper is the first to review the scene flow estimation field, which...
research
07/17/2010

A Machine Learning Approach to Recovery of Scene Geometry from Images

Recovering the 3D structure of the scene from images yields useful infor...
research
07/12/2022

M-FUSE: Multi-frame Fusion for Scene Flow Estimation

Recently, neural network for scene flow estimation show impressive resul...
research
04/15/2020

Visual Descriptor Learning from Monocular Video

Correspondence estimation is one of the most widely researched and yet o...

Please sign up or login with your details

Forgot password? Click here to reset