DOPS: Learning to Detect 3D Objects and Predict their 3D Shapes

04/02/2020
by   Mahyar Najibi, et al.
0

We propose DOPS, a fast single-stage 3D object detection method for LIDAR data. Previous methods often make domain-specific design decisions, for example projecting points into a bird-eye view image in autonomous driving scenarios. In contrast, we propose a general-purpose method that works on both indoor and outdoor scenes. The core novelty of our method is a fast, single-pass architecture that both detects objects in 3D and estimates their shapes. 3D bounding box parameters are estimated in one pass for every point, aggregated through graph convolutions, and fed into a branch of the network that predicts latent codes representing the shape of each detected object. The latent shape space and shape decoder are learned on a synthetic dataset and then used as supervision for the end-to-end training of the 3D object detection pipeline. Thus our model is able to extract shapes without access to ground-truth shape information in the target dataset. During experiments, we find that our proposed method achieves state-of-the-art results by  5 ScanNet scenes, and it gets top results by 3.4 while reproducing the shapes of detected cars.

READ FULL TEXT

page 5

page 7

page 8

research
12/21/2020

From Points to Multi-Object 3D Reconstruction

We propose a method to detect and reconstruct multiple 3D objects from a...
research
12/06/2017

Joint 3D Proposal Generation and Object Detection from View Aggregation

We present AVOD, an Aggregate View Object Detection network for autonomo...
research
03/03/2023

BSH-Det3D: Improving 3D Object Detection with BEV Shape Heatmap

The progress of LiDAR-based 3D object detection has significantly enhanc...
research
12/09/2021

3D-VField: Learning to Adversarially Deform Point Clouds for Robust 3D Object Detection

As 3D object detection on point clouds relies on the geometrical relatio...
research
11/03/2020

Faraway-Frustum: Dealing with Lidar Sparsity for 3D Object Detection using Fusion

Learned pointcloud representations do not generalize well with an increa...
research
09/17/2011

Generalised Object Detection and Semantic Analysis: Casino Example using Matlab

Matlab version 7.1 had been used to detect playing cards on a Casino tab...
research
11/23/2016

Straight to Shapes: Real-time Detection of Encoded Shapes

Current object detection approaches predict bounding boxes, but these pr...

Please sign up or login with your details

Forgot password? Click here to reset