Ground-aware Monocular 3D Object Detection for Autonomous Driving

02/01/2021
by   YuXuan Liu, et al.
14

Estimating the 3D position and orientation of objects in the environment with a single RGB camera is a critical and challenging task for low-cost urban autonomous driving and mobile robots. Most of the existing algorithms are based on the geometric constraints in 2D-3D correspondence, which stems from generic 6D object pose estimation. We first identify how the ground plane provides additional clues in depth reasoning in 3D detection in driving scenes. Based on this observation, we then improve the processing of 3D anchors and introduce a novel neural network module to fully utilize such application-specific priors in the framework of deep learning. Finally, we introduce an efficient neural network embedded with the proposed module for 3D object detection. We further verify the power of the proposed module with a neural network designed for monocular depth prediction. The two proposed networks achieve state-of-the-art performances on the KITTI 3D object detection and depth prediction benchmarks, respectively. The code will be published in https://www.github.com/Owen-Liuyuxuan/visualDet3D

READ FULL TEXT

page 2

page 6

page 7

research
03/21/2022

MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformer

Monocular 3D object detection is an important yet challenging task in au...
research
08/25/2021

AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

Existing deep learning-based approaches for monocular 3D object detectio...
research
07/13/2019

M3D-RPN: Monocular 3D Region Proposal Network for Object Detection

Understanding the world in 3D is a critical component of urban autonomou...
research
12/08/2021

SoK: Vehicle Orientation Representations for Deep Rotation Estimation

In recent years, there is an influx of deep learning models for 3D vehic...
research
12/28/2021

The Devil is in the Task: Exploiting Reciprocal Appearance-Localization Features for Monocular 3D Object Detection

Low-cost monocular 3D object detection plays a fundamental role in auton...
research
04/22/2021

FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detection

Monocular 3D object detection is an important task for autonomous drivin...
research
12/16/2021

Road-aware Monocular Structure from Motion and Homography Estimation

Structure from motion (SFM) and ground plane homography estimation are c...

Please sign up or login with your details

Forgot password? Click here to reset