Unsupervised Monocular Depth Learning with Integrated Intrinsics and Spatio-Temporal Constraints

11/02/2020
by   Kenny Chen, et al.
2

Monocular depth inference has gained tremendous attention from researchers in recent years and remains as a promising replacement for expensive time-of-flight sensors, but issues with scale acquisition and implementation overhead still plague these systems. To this end, this work presents an unsupervised learning framework that is able to predict at-scale depth maps and egomotion, in addition to camera intrinsics, from a sequence of monocular images via a single network. Our method incorporates both spatial and temporal geometric constraints to resolve depth and pose scale factors, which are enforced within the supervisory reconstruction loss functions at training time. Only unlabeled stereo sequences are required for training the weights of our single-network architecture, which reduces overall implementation overhead as compared to previous methods. Our results demonstrate strong performance when compared to the current state-of-the-art on multiple sequences of the KITTI driving dataset.

READ FULL TEXT

page 1

page 2

page 3

page 5

research
09/20/2017

UnDeepVO: Monocular Visual Odometry through Unsupervised Deep Learning

We propose a novel monocular visual odometry (VO) system called UnDeepVO...
research
03/24/2022

Unsupervised Simultaneous Learning for Camera Re-Localization and Depth Estimation from Video

We present an unsupervised simultaneous learning framework for the task ...
research
08/27/2018

A Deeper Insight into the UnDEMoN: Unsupervised Deep Network for Depth and Ego-Motion Estimation

This paper presents an unsupervised deep learning framework called UnDEM...
research
03/31/2021

Full Surround Monodepth from Multiple Cameras

Self-supervised monocular depth and ego-motion estimation is a promising...
research
12/08/2018

Unsupervised Learning of Monocular Depth Estimation with Bundle Adjustment, Super-Resolution and Clip Loss

We present a novel unsupervised learning framework for single view depth...
research
12/01/2017

Learning Depth from Monocular Videos using Direct Methods

The ability to predict depth from a single image - using recent advances...
research
04/09/2020

Masked GANs for Unsupervised Depth and Pose Prediction with Scale Consistency

Previous works have shown that adversarial learning can be used for unsu...

Please sign up or login with your details

Forgot password? Click here to reset