DistanceNet: Estimating Traveled Distance from Monocular Images using a Recurrent Convolutional Neural Network

04/17/2019
by   Robin Kreuzig, et al.
0

Classical monocular vSLAM/VO methods suffer from the scale ambiguity problem. Hybrid approaches solve this problem by adding deep learning methods, for example by using depth maps which are predicted by a CNN. We suggest that it is better to base scale estimation on estimating the traveled distance for a set of subsequent images. In this paper, we propose a novel end-to-end many-to-one traveled distance estimator. By using a deep recurrent convolutional neural network (RCNN), the traveled distance between the first and last image of a set of consecutive frames is estimated by our DistanceNet. Geometric features are learned in the CNN part of our model, which are subsequently used by the RNN to learn dynamics and temporal information. Moreover, we exploit the natural order of distances by using ordinal regression to predict the distance. The evaluation on the KITTI dataset shows that our approach outperforms current state-of-the-art deep learning pose estimators and classical mono vSLAM/VO methods in terms of distance prediction. Thus, our DistanceNet can be used as a component to solve the scale problem and help improve current and future classical mono vSLAM/VO methods.

READ FULL TEXT

page 1

page 3

research
11/27/2018

MagicVO: End-to-End Monocular Visual Odometry through Deep Bi-directional Recurrent Convolutional Neural Network

This paper proposes a new framework to solve the problem of monocular vi...
research
12/19/2020

Self-supervised monocular depth estimation from oblique UAV videos

UAVs have become an essential photogrammetric measurement as they are af...
research
09/25/2017

DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks

This paper studies monocular visual odometry (VO) problem. Most of exist...
research
11/25/2018

Guided Feature Selection for Deep Visual Odometry

We present a novel end-to-end visual odometry architecture with guided f...
research
07/04/2016

A Two-Streamed Network for Estimating Fine-Scaled Depth Maps from Single RGB Images

Estimating depth from a single RGB image is an ill-posed and inherently ...
research
08/20/2021

Convolutional Neural Network (CNN) vs Visual Transformer (ViT) for Digital Holography

In Digital Holography (DH), it is crucial to extract the object distance...
research
06/22/2018

Deep SNP: An End-to-end Deep Neural Network with Attention-based Localization for Break-point Detection in SNP Array Genomic data

Diagnosis and risk stratification of cancer and many other diseases requ...

Please sign up or login with your details

Forgot password? Click here to reset