Moving Indoor: Unsupervised Video Depth Learning in Challenging Environments

10/20/2019
by   Junsheng Zhou, et al.
18

Recently unsupervised learning of depth from videos has made remarkable progress and the results are comparable to fully supervised methods in outdoor scenes like KITTI. However, there still exist great challenges when directly applying this technology in indoor environments, e.g., large areas of non-texture regions like white wall, more complex ego-motion of handheld camera, transparent glasses and shiny objects. To overcome these problems, we propose a new optical-flow based training paradigm which reduces the difficulty of unsupervised learning by providing a clearer training target and handles the non-texture regions. Our experimental evaluation demonstrates that the result of our method is comparable to fully supervised methods on the NYU Depth V2 benchmark. To the best of our knowledge, this is the first quantitative result of purely unsupervised learning method reported on indoor datasets.

READ FULL TEXT

page 3

page 6

page 7

page 8

research
11/16/2017

Occlusion Aware Unsupervised Learning of Optical Flow

It has been recently shown that a convolutional neural network can learn...
research
03/06/2018

GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose

We propose GeoNet, a jointly unsupervised learning framework for monocul...
research
11/15/2018

Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videos

Learning to predict scene depth from RGB inputs is a challenging task bo...
research
07/15/2020

P^2Net: Patch-match and Plane-regularization for Unsupervised Indoor Depth Estimation

This paper tackles the unsupervised depth estimation task in indoor envi...
research
10/14/2020

Semantic Flow-guided Motion Removal Method for Robust Mapping

Moving objects in scenes are still a severe challenge for the SLAM syste...
research
11/20/2019

Unsupervised Monocular Depth Prediction for Indoor Continuous Video Streams

This paper studies unsupervised monocular depth prediction problem. Most...
research
06/04/2020

Unsupervised Depth Learning in Challenging Indoor Video: Weak Rectification to Rescue

Single-view depth estimation using CNNs trained from unlabelled videos h...

Please sign up or login with your details

Forgot password? Click here to reset