From Voxel to Point: IoU-guided 3D Object Detection for Point Cloud with Voxel-to-Point Decoder

08/08/2021
by   Jiale Li, et al.
0

In this paper, we present an Intersection-over-Union (IoU) guided two-stage 3D object detector with a voxel-to-point decoder. To preserve the necessary information from all raw points and maintain the high box recall in voxel based Region Proposal Network (RPN), we propose a residual voxel-to-point decoder to extract the point features in addition to the map-view features from the voxel based RPN. We use a 3D Region of Interest (RoI) alignment to crop and align the features with the proposal boxes for accurately perceiving the object position. The RoI-Aligned features are finally aggregated with the corner geometry embeddings that can provide the potentially missing corner information in the box refinement stage. We propose a simple and efficient method to align the estimated IoUs to the refined proposal boxes as a more relevant localization confidence. The comprehensive experiments on KITTI and Waymo Open Dataset demonstrate that our method achieves significant improvements with novel architectures against the existing methods. The code is available on Github URL[<https://github.com/jialeli1/From-Voxel-to-Point>].

READ FULL TEXT
research
12/31/2020

Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection

Recent advances on 3D object detection heavily rely on how the 3D data a...
research
07/22/2019

STD: Sparse-to-Dense 3D Object Detector for Point Cloud

We present a new two-stage 3D object detection framework, named sparse-t...
research
08/08/2019

Fast Point R-CNN

We present a unified, efficient and effective framework for point-cloud ...
research
05/31/2022

Voxel Field Fusion for 3D Object Detection

In this work, we present a conceptually simple yet effective framework f...
research
01/18/2022

Attention-based Proposals Refinement for 3D Object Detection

Recent advances in 3D object detection is made by developing the refinem...
research
08/22/2023

An extensible point-based method for data chart value detection

We present an extensible method for identifying semantic points to rever...
research
07/17/2023

Box-DETR: Understanding and Boxing Conditional Spatial Queries

Conditional spatial queries are recently introduced into DEtection TRans...

Please sign up or login with your details

Forgot password? Click here to reset