Unsupervised Learning of Depth and Ego-Motion from Panoramic Video

01/04/2019
by   Alisha Sharma, et al.
14

We introduce a convolutional neural network model for unsupervised learning of depth and ego-motion from cylindrical panoramic video. Panoramic depth estimation is an important technology for applications such as autonomous robotic navigation, virtual reality, and 3D modeling. In contrast to previous approaches for applying convolutional neural networks to panoramic imagery, we use the cylindrical panoramic projection which allows for the use of the traditional CNN layers such as convolutional filters and max pooling without modification. Our evaluation on synthetic and real data shows that unsupervised learning of depth and ego-motion on panoramic images increases depth prediction accuracy in comparison to training on perspective images which have a narrower field-of-view.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

research
10/14/2020

Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video with Applications for Virtual Reality

We introduce a convolutional neural network model for unsupervised learn...
research
04/01/2021

Unsupervised Learning of Monocular Depth and Ego-Motion Using Multiple Masks

A new unsupervised learning method of depth and ego-motion using multipl...
research
05/24/2017

Unsupervised Learning Layers for Video Analysis

This paper presents two unsupervised learning layers (UL layers) for lab...
research
01/22/2016

Unsupervised convolutional neural networks for motion estimation

Traditional methods for motion estimation estimate the motion field F be...
research
12/12/2013

Unsupervised learning of depth and motion

We present a model for the joint estimation of disparity and motion. The...
research
11/30/2022

A hybrid motion estimation technique for fisheye video sequences based on equisolid re-projection

Capturing large fields of view with only one camera is an important aspe...
research
06/09/2023

Circular Rectifiction of 3D Video and Efficient Modification of 3D-HEVC

Video acquired from multiple cameras located along a line is often recti...

Please sign up or login with your details

Forgot password? Click here to reset