Center3D: Center-based Monocular 3D Object Detection with Joint Depth Understanding

05/27/2020
by   Yunlei Tang, et al.
8

Localizing objects in 3D space and understanding their associated 3D properties is challenging given only monocular RGB images. The situation is compounded by the loss of depth information during perspective projection. We present Center3D, a one-stage anchor-free approach, to efficiently estimate 3D location and depth using only monocular RGB images. By exploiting the difference between 2D and 3D centers, we are able to estimate depth consistently. Center3D uses a combination of classification and regression to understand the hidden depth information more robustly than each method alone. Our method employs two joint approaches: (1) LID: a classification-dominated approach with sequential Linear Increasing Discretization. (2) DepJoint: a regression-dominated approach with multiple Eigen's transformations for depth estimation. Evaluating on KITTI dataset for moderate objects, Center3D improved the AP in BEV from 29.7% to 42.8%, and the AP in 3D from 18.6% to 39.1%. Compared with state-of-the-art detectors, Center3D has achieved the best speed-accuracy trade-off in realtime monocular object detection.

READ FULL TEXT

page 3

page 4

page 7

research
04/18/2021

MonoGRNet: A General Framework for Monocular 3D Object Detection

Detecting and localizing objects in the real 3D space, which plays a cru...
research
09/17/2019

Task-Aware Monocular Depth Estimation for 3D Object Detection

Monocular depth estimation enables 3D perception from a single 2D image,...
research
05/04/2020

Anchors Based Method for Fingertips Position Estimation from a Monocular RGB Image using Deep Neural Network

In Virtual, augmented, and mixed reality, the use of hand gestures is in...
research
05/04/2020

Anchors based method for fingertips position from a monocular RGB image using Deep Neural Network

In Virtual, augmented, and mixed reality, the use of hand gestures is in...
research
05/19/2022

Diversity Matters: Fully Exploiting Depth Clues for Reliable Monocular 3D Object Detection

As an inherently ill-posed problem, depth estimation from single images ...
research
07/28/2021

Aug3D-RPN: Improving Monocular 3D Object Detection by Synthetic Images with Virtual Depth

Current geometry-based monocular 3D object detection models can efficien...
research
07/18/2022

DID-M3D: Decoupling Instance Depth for Monocular 3D Object Detection

Monocular 3D detection has drawn much attention from the community due t...

Please sign up or login with your details

Forgot password? Click here to reset