Unsupervised Simultaneous Learning for Camera Re-Localization and Depth Estimation from Video

by   Shun Taguchi, et al.

We present an unsupervised simultaneous learning framework for the task of monocular camera re-localization and depth estimation from unlabeled video sequences. Monocular camera re-localization refers to the task of estimating the absolute camera pose from an instance image in a known environment, which has been intensively studied for alternative localization in GPS-denied environments. In recent works, camera re-localization methods are trained via supervised learning from pairs of camera images and camera poses. In contrast to previous works, we propose a completely unsupervised learning framework for camera re-localization and depth estimation, requiring only monocular video sequences for training. In our framework, we train two networks that estimate the scene coordinates using directions and the depth map from each image which are then combined to estimate the camera pose. The networks can be trained through the minimization of loss functions based on our loop closed view synthesis. In experiments with the 7-scenes dataset, the proposed method outperformed the re-localization of the state-of-the-art visual SLAM, ORB-SLAM3. Our method also outperforms state-of-the-art monocular depth estimation in a trained environment.


page 1

page 4

page 7


Position Estimation of Camera Based on Unsupervised Learning

It is an exciting task to recover the scene's 3d-structure and camera po...

SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning

Monocular depth estimation in the wild inherently predicts depth up to a...

Unsupervised Learning of Monocular Depth Estimation with Bundle Adjustment, Super-Resolution and Clip Loss

We present a novel unsupervised learning framework for single view depth...

Unsupervised Learning-based Depth Estimation aided Visual SLAM Approach

The RGB-D camera maintains a limited range for working and is hard to ac...

Unsupervised Monocular Depth Learning with Integrated Intrinsics and Spatio-Temporal Constraints

Monocular depth inference has gained tremendous attention from researche...

GEN-SLAM: Generative Modeling for Monocular Simultaneous Localization and Mapping

We present a Deep Learning based system for the twin tasks of localizati...

3D Hierarchical Refinement and Augmentation for Unsupervised Learning of Depth and Pose from Monocular Video

Depth and ego-motion estimations are essential for the localization and ...

Please sign up or login with your details

Forgot password? Click here to reset