Unsupervised Learning-based Depth Estimation aided Visual SLAM Approach

01/22/2019
by   Mingyang Geng, et al.
0

The RGB-D camera maintains a limited range for working and is hard to accurately measure the depth information in a far distance. Besides, the RGB-D camera will easily be influenced by strong lighting and other external factors, which will lead to a poor accuracy on the acquired environmental depth information. Recently, deep learning technologies have achieved great success in the visual SLAM area, which can directly learn high-level features from the visual inputs and improve the estimation accuracy of the depth information. Therefore, deep learning technologies maintain the potential to extend the source of the depth information and improve the performance of the SLAM system. However, the existing deep learning-based methods are mainly supervised and require a large amount of ground-truth depth data, which is hard to acquire because of the realistic constraints. In this paper, we first present an unsupervised learning framework, which not only uses image reconstruction for supervising but also exploits the pose estimation method to enhance the supervised signal and add training constraints for the task of monocular depth and camera motion estimation. Furthermore, we successfully exploit our unsupervised learning framework to assist the traditional ORB-SLAM system when the initialization module of ORB-SLAM method could not match enough features. Qualitative and quantitative experiments have shown that our unsupervised learning framework performs the depth estimation task comparable to the supervised methods and outperforms the previous state-of-the-art approach by 13.5% on KITTI dataset. Besides, our unsupervised learning framework could significantly accelerate the initialization process of ORB-SLAM system and effectively improve the accuracy on environmental mapping in strong lighting and weak texture scenes.

READ FULL TEXT
research
03/14/2022

Unsupervised Learning Based Focal Stack Camera Depth Estimation

We propose an unsupervised deep learning based method to estimate depth ...
research
03/24/2022

Unsupervised Simultaneous Learning for Camera Re-Localization and Depth Estimation from Video

We present an unsupervised simultaneous learning framework for the task ...
research
05/05/2018

Position Estimation of Camera Based on Unsupervised Learning

It is an exciting task to recover the scene's 3d-structure and camera po...
research
09/16/2018

GANVO: Unsupervised Deep Monocular Visual Odometry and Depth Estimation with Generative Adversarial Networks

In the last decade, supervised deep learning approaches have been extens...
research
11/09/2020

Deep Learning based Monocular Depth Prediction: Datasets, Methods and Applications

Estimating depth from RGB images can facilitate many computer vision tas...
research
08/04/2019

Unsupervised Learning of Depth and Deep Representation for Visual Odometry from Monocular Videos in a Metric Space

For ego-motion estimation, the feature representation of the scenes is c...
research
10/27/2022

Robust Monocular Localization of Drones by Adapting Domain Maps to Depth Prediction Inaccuracies

We present a novel monocular localization framework by jointly training ...

Please sign up or login with your details

Forgot password? Click here to reset