FusionMapping: Learning Depth Prediction with Monocular Images and 2D Laser Scans

11/29/2019
by   Peng Yin, et al.
17

Acquiring accurate three-dimensional depth information conventionally requires expensive multibeam LiDAR devices. Recently, researchers have developed a less expensive option by predicting depth information from two-dimensional color imagery. However, there still exists a substantial gap in accuracy between depth information estimated from two-dimensional images and real LiDAR point-cloud. In this paper, we introduce a fusion-based depth prediction method, called FusionMapping. This is the first method that fuses colored imagery and two-dimensional laser scan to estimate depth in-formation. More specifically, we propose an autoencoder-based depth prediction network and a novel point-cloud refinement network for depth estimation. We analyze the performance of our FusionMapping approach on the KITTI LiDAR odometry dataset and an indoor mobile robot system. The results show that our introduced approach estimates depth with better accuracy when compared to existing methods.

READ FULL TEXT

page 2

page 3

page 5

page 6

research
05/17/2022

Efficient Stereo Depth Estimation for Pseudo LiDAR: A Self-Supervised Approach Based on Multi-Input ResNet Encoder

Perception and localization are essential for autonomous delivery vehicl...
research
09/04/2022

Pseudo-LiDAR for Visual Odometry

In the existing methods, LiDAR odometry shows superior performance, but ...
research
01/17/2021

PLUME: Efficient 3D Object Detection from Stereo Images

3D object detection plays a significant role in various robotic applicat...
research
11/24/2021

SM3D: Simultaneous Monocular Mapping and 3D Detection

Mapping and 3D detection are two major issues in vision-based robotics, ...
research
10/19/2022

Time and Cost-Efficient Bathymetric Mapping System using Sparse Point Cloud Generation and Automatic Object Detection

Generating 3D point cloud (PC) data from noisy sonar measurements is a p...
research
08/27/2023

Calibrating Panoramic Depth Estimation for Practical Localization and Mapping

The absolute depth values of surrounding environments provide crucial cu...
research
09/12/2019

3D Ken Burns Effect from a Single Image

The Ken Burns effect allows animating still images with a virtual camera...

Please sign up or login with your details

Forgot password? Click here to reset