Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depth

04/15/2019
by   Rui Wang, et al.
12

Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We propose a learning-based, multi-view dense depth map and odometry estimation method that uses Recurrent Neural Networks (RNN) and trains utilizing multi-view image reprojection and forward-backward flow-consistency losses. Our model can be trained in a supervised or even unsupervised mode. It is designed for depth and visual odometry estimation from video where the input frames are temporally correlated. However, it also generalizes to single-view depth estimation. Our method produces superior results to the state-of-the-art approaches for single-view and multi-view learning-based depth estimation on the KITTI driving dataset.

READ FULL TEXT

page 1

page 3

page 6

page 8

research
05/17/2018

Recurrent Neural Network for Learning DenseDepth and Ego-Motion from Video

Learning-based, single-view depth estimation often generalizes poorly to...
research
03/11/2018

Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction

Despite learning based methods showing promising results in single view ...
research
11/22/2016

Single-View and Multi-View Depth Fusion

Dense and accurate 3D mapping from a monocular sequence is a key technol...
research
12/16/2021

On the Uncertain Single-View Depths in Endoscopies

Estimating depth from endoscopic images is a pre-requisite for a wide se...
research
05/05/2022

Exploiting Correspondences with All-pairs Correlations for Multi-view Depth Estimation

Multi-view depth estimation plays a critical role in reconstructing and ...
research
09/08/2023

Robot Localization and Mapping Final Report – Sequential Adversarial Learning for Self-Supervised Deep Visual Odometry

Visual odometry (VO) and SLAM have been using multi-view geometry via lo...
research
03/02/2018

Unsupervised Odometry and Depth Learning for Endoscopic Capsule Robots

In the last decade, many medical companies and research groups have trie...

Please sign up or login with your details

Forgot password? Click here to reset