DFineNet: Ego-Motion Estimation and Depth Refinement from Sparse, Noisy Depth Input with RGB Guidance

03/15/2019
by   Yilun Zhang, et al.
2

Depth estimation is an important capability for autonomous vehicles to understand and reconstruct 3D environments as well as avoid obstacles during the execution. Accurate depth sensors such as LiDARs are often heavy, expensive and can only provide sparse depth while lighter depth sensors such as stereo cameras are noiser in comparison. We propose an end-to-end learning algorithm that is capable of using sparse, noisy input depth for refinement and depth completion. Our model also produces the camera pose as a byproduct, making it a great solution for autonomous systems. We evaluate our approach on both indoor and outdoor datasets. Empirical results show that our method performs well on the KITTI kitti_geiger2012we dataset when compared to other competing methods, while having superior performance in dealing with sparse, noisy input depth on the TUM sturm12iros dataset.

READ FULL TEXT

page 1

page 3

page 5

page 7

research
06/21/2019

Deep RGB-D Canonical Correlation Analysis For Sparse Depth Completion

In this paper, we propose our Correlation For Completion Network (CFCNet...
research
04/05/2022

Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimation

Deep-learning-based approaches to depth estimation are rapidly advancing...
research
12/15/2021

Depth Refinement for Improved Stereo Reconstruction

Depth estimation is a cornerstone of a vast number of applications requi...
research
04/25/2019

Indoor dense depth map at drone hovering

Autonomous Micro Aerial Vehicles (MAVs) gained tremendous attention in r...
research
09/17/2019

Deep End-to-End Alignment and Refinement for Time-of-Flight RGB-D Module

Recently, it is increasingly popular to equip mobile RGB cameras with Ti...
research
08/07/2017

Learning for Active 3D Mapping

We propose an active 3D mapping method for depth sensors, which allow in...
research
12/10/2021

Sparse Depth Completion with Semantic Mesh Deformation Optimization

Sparse depth measurements are widely available in many applications such...

Please sign up or login with your details

Forgot password? Click here to reset