Deep Planar Parallax for Monocular Depth Estimation

01/09/2023
by   Haoqian Liang, et al.
0

Depth estimation is a fundamental problem in the perception system of autonomous driving scenes. Although autonomous driving is challenging, much prior knowledge can still be utilized, by which the sophistication of the problem can be effectively restricted. Some previous works introduce the road plane prior to the depth estimation problem according to the Planar Parallax Geometry. However, we find that their usages are not effective, leaving the network cannot learn the geometric information. To this end, we analyze this problem in detail and reveal that explicit warping of consecutive frames and flow pre-training can effectively bring the geometric prior into learning. Furthermore, we propose Planar Position Embedding to deal with the intrinsic weakness of plane parallax geometry. Comprehensive experimental results on autonomous driving datasets like KITTI and Waymo Open Dataset (WOD) demonstrate that our Planar Parallax Network(PPNet) dramatically outperforms existing learning-based methods.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

page 13

page 14

page 15

research
06/08/2022

Depth Estimation Matters Most: Improving Per-Object Depth Estimation for Monocular 3D Detection and Tracking

Monocular image-based 3D perception has become an active research area i...
research
03/17/2023

A Simple Attempt for 3D Occupancy Estimation in Autonomous Driving

The task of estimating 3D occupancy from surrounding view images is an e...
research
02/02/2022

PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimation

Omnidirectional 3D information is essential for a wide range of applicat...
research
12/16/2021

Road-aware Monocular Structure from Motion and Homography Estimation

Structure from motion (SFM) and ground plane homography estimation are c...
research
05/07/2023

Bi-Mapper: Holistic BEV Semantic Mapping for Autonomous Driving

A semantic map of the road scene, covering fundamental road elements, is...
research
08/24/2023

Panoptic-Depth Color Map for Combination of Depth and Image Segmentation

Image segmentation and depth estimation are crucial tasks in computer vi...
research
08/04/2023

Diffusion-Augmented Depth Prediction with Sparse Annotations

Depth estimation aims to predict dense depth maps. In autonomous driving...

Please sign up or login with your details

Forgot password? Click here to reset