Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction

03/11/2018
by   Huangying Zhan, et al.
0

Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estimation explore the possibility of learning without full supervision via minimizing photometric error. In this paper, we explore the use of stereo sequences for learning depth and visual odometry. The use of stereo sequences enables the use of both spatial (between left-right pairs) and temporal (forward backward) photometric warp error, and constrains the scene depth and camera motion to be in a common, real-world scale. At test time our framework is able to estimate single view depth and two-view odometry from a monocular sequence. We also show how we can improve on a standard photometric warp loss by considering a warp of deep features. We show through extensive experiments that: (i) jointly training for single view depth and visual odometry improves depth prediction because of the additional constraint imposed on depths and achieves competitive results for visual odometry; (ii) deep feature-based warping loss improves upon simple photometric warp loss for both single view depth estimation and visual odometry. Our method outperforms existing learning based methods on the KITTI driving dataset in both tasks. The source code is available at https://github.com/Huangying-Zhan/Depth-VO-Feat.

READ FULL TEXT

page 1

page 4

page 7

research
04/15/2019

Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depth

Deep learning-based, single-view depth estimation methods have recently ...
research
08/08/2022

Deep Patch Visual Odometry

We propose Deep Patch Visual Odometry (DPVO), a new deep learning system...
research
10/31/2020

TartanVO: A Generalizable Learning-based VO

We present the first learning-based visual odometry (VO) model, which ge...
research
09/03/2019

Unsupervised Video Depth Estimation Based on Ego-motion and Disparity Consensus

Unsupervised learning based depth estimation methods have received more ...
research
12/06/2021

3D Hierarchical Refinement and Augmentation for Unsupervised Learning of Depth and Pose from Monocular Video

Depth and ego-motion estimations are essential for the localization and ...
research
09/21/2019

Visual Odometry Revisited: What Should Be Learnt?

In this work we present a monocular visual odometry (VO) algorithm which...
research
03/02/2018

Unsupervised Odometry and Depth Learning for Endoscopic Capsule Robots

In the last decade, many medical companies and research groups have trie...

Please sign up or login with your details

Forgot password? Click here to reset