Is Pseudo-Lidar needed for Monocular 3D Object detection?

08/13/2021
by   Dennis Park, et al.
14

Recent progress in 3D object detection from single images leverages monocular depth estimation as a way to produce 3D pointclouds, turning cameras into pseudo-lidar sensors. These two-stage detectors improve with the accuracy of the intermediate depth estimation network, which can itself be improved without manual labels via large-scale self-supervised learning. However, they tend to suffer from overfitting more than end-to-end methods, are more complex, and the gap with similar lidar-based detectors remains significant. In this work, we propose an end-to-end, single stage, monocular 3D object detector, DD3D, that can benefit from depth pre-training like pseudo-lidar methods, but without their limitations. Our architecture is designed for effective information transfer between depth estimation and 3D detection, allowing us to scale with the amount of unlabeled pre-training data. Our method achieves state-of-the-art results on two challenging benchmarks, with 16.34 Pedestrians (respectively) on the KITTI-3D benchmark, and 41.5 NuScenes.

READ FULL TEXT
research
07/05/2023

SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detection

One of the key problems in 3D object detection is to reduce the accuracy...
research
09/20/2022

Self-supervised 3D Object Detection from Monocular Pseudo-LiDAR

There have been attempts to detect 3D objects by fusion of stereo camera...
research
06/08/2022

Delving into the Pre-training Paradigm of Monocular 3D Object Detection

The labels of monocular 3D object detection (M3OD) are expensive to obta...
research
10/29/2022

Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision

Recent advances in monocular 3D detection leverage a depth estimation ne...
research
10/05/2022

Depth Is All You Need for Monocular 3D Detection

A key contributor to recent progress in 3D detection from single images ...
research
07/06/2021

Neighbor-Vote: Improving Monocular 3D Object Detection through Neighbor Distance Voting

As cameras are increasingly deployed in new application domains such as ...
research
12/10/2020

Demystifying Pseudo-LiDAR for Monocular 3D Object Detection

Pseudo-LiDAR-based methods for monocular 3D object detection have genera...

Please sign up or login with your details

Forgot password? Click here to reset