Depth Refinement for Improved Stereo Reconstruction

12/15/2021
by   Amit Bracha, et al.
19

Depth estimation is a cornerstone of a vast number of applications requiring 3D assessment of the environment, such as robotics, augmented reality, and autonomous driving to name a few. One prominent technique for depth estimation is stereo matching which has several advantages: it is considered more accessible than other depth-sensing technologies, can produce dense depth estimates in real-time, and has benefited greatly from the advances of deep learning in recent years. However, current techniques for depth estimation from stereoscopic images still suffer from a built-in drawback. To reconstruct depth, a stereo matching algorithm first estimates the disparity map between the left and right images before applying a geometric triangulation. A simple analysis reveals that the depth error is quadratically proportional to the object's distance. Therefore, constant disparity errors are translated to large depth errors for objects far from the camera. To mitigate this quadratic relation, we propose a simple but effective method that uses a refinement network for depth estimation. We show analytical and empirical results suggesting that the proposed learning procedure reduces this quadratic relation. We evaluate the proposed refinement procedure on well-known benchmarks and datasets, like Sceneflow and KITTI datasets, and demonstrate significant improvements in the depth accuracy metric.

READ FULL TEXT
research
12/10/2020

Direct Depth Learning Network for Stereo Matching

Being a crucial task of autonomous driving, Stereo matching has made gre...
research
07/13/2022

Robust and accurate depth estimation by fusing LiDAR and Stereo

Depth estimation is one of the key technologies in some fields such as a...
research
12/22/2022

Depth Estimation maps of lidar and stereo images

This paper as technology report is focusing on evaluation and performanc...
research
03/15/2019

DFineNet: Ego-Motion Estimation and Depth Refinement from Sparse, Noisy Depth Input with RGB Guidance

Depth estimation is an important capability for autonomous vehicles to u...
research
06/01/2020

A Survey on Deep Learning Techniques for Stereo-based Depth Estimation

Estimating depth from RGB images is a long-standing ill-posed problem, w...
research
07/06/2020

Wasserstein Distances for Stereo Disparity Estimation

Existing approaches to depth or disparity estimation output a distributi...
research
04/14/2023

Efficient Incremental Penetration Depth Estimation between Convex Geometries

Penetration depth (PD) is essential for robotics due to its extensive ap...

Please sign up or login with your details

Forgot password? Click here to reset