Visual Depth Mapping from Monocular Images using Recurrent Convolutional Neural Networks

12/10/2018
by   John Mern, et al.
22

A reliable sense-and-avoid system is critical to enabling safe autonomous operation of unmanned aircraft. Existing sense-and-avoid methods often require specialized sensors that are too large or power intensive for use on small unmanned vehicles. This paper presents a method to estimate object distances based on visual image sequences, allowing for the use of low-cost, on-board monocular cameras as simple collision avoidance sensors. We present a deep recurrent convolutional neural network and training method to generate depth maps from video sequences. Our network is trained using simulated camera and depth data generated with Microsoft's AirSim simulator. Empirically, we show that our model achieves superior performance compared to models generated using prior methods.We further demonstrate that the method can be used for sense-and-avoid of obstacles in simulation.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
12/03/2020

Obstacle Avoidance Using a Monocular Camera

A collision avoidance system based on simple digital cameras would help ...
research
09/20/2022

Self-supervised 3D Object Detection from Monocular Pseudo-LiDAR

There have been attempts to detect 3D objects by fusion of stereo camera...
research
09/20/2016

Geometry-Based Next Frame Prediction from Monocular Video

We consider the problem of next frame prediction from video input. A rec...
research
02/10/2020

Autonomous quadrotor obstacle avoidance based on dueling double deep recurrent Q-learning with monocular vision

The rapid development of unmanned aerial vehicles (UAV) puts forward a h...
research
12/27/2021

Depth estimation of endoscopy using sim-to-real transfer

In order to use the navigation system effectively, distance information ...
research
02/10/2020

Autonomous quadrotor obstacle avoidance based on dueling double deep recurrent Q network with monocular vision

The fast developing of unmanned aerial vehicle(UAV) brings forward the h...
research
06/13/2021

Siamese Network Training Using Sampled Triplets and Image Transformation

The device used in this work detects the objects over the surface of the...

Please sign up or login with your details

Forgot password? Click here to reset