Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection

12/31/2020
by   Jiajun Deng, et al.
0

Recent advances on 3D object detection heavily rely on how the 3D data are represented, i.e., voxel-based or point-based representation. Many existing high performance 3D detectors are point-based because this structure can better retain precise point positions. Nevertheless, point-level features lead to high computation overheads due to unordered storage. In contrast, the voxel-based structure is better suited for feature extraction but often yields lower accuracy because the input data are divided into grids. In this paper, we take a slightly different viewpoint – we find that precise positioning of raw points is not essential for high performance 3D object detection and that the coarse voxel granularity can also offer sufficient detection accuracy. Bearing this view in mind, we devise a simple but effective voxel-based framework, named Voxel R-CNN. By taking full advantage of voxel features in a two stage approach, our method achieves comparable detection accuracy with state-of-the-art point-based models, but at a fraction of the computation cost. Voxel R-CNN consists of a 3D backbone network, a 2D bird-eye-view (BEV) Region Proposal Network and a detect head. A voxel RoI pooling is devised to extract RoI features directly from voxel features for further refinement. Extensive experiments are conducted on the widely used KITTI Dataset and the more recent Waymo Open Dataset. Our results show that compared to existing voxel-based methods, Voxel R-CNN delivers a higher detection accuracy while maintaining a real-time frame processing rate, i.e., at a speed of 25 FPS on an NVIDIA RTX 2080 Ti GPU. The code will be make available soon.

READ FULL TEXT
research
02/26/2023

Pillar R-CNN for Point Cloud 3D Object Detection

The performance of point cloud 3D object detection hinges on effectively...
research
05/16/2022

PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detection

Real-time and high-performance 3D object detection is of critical import...
research
08/08/2021

From Voxel to Point: IoU-guided 3D Object Detection for Point Cloud with Voxel-to-Point Decoder

In this paper, we present an Intersection-over-Union (IoU) guided two-st...
research
01/18/2022

Attention-based Proposals Refinement for 3D Object Detection

Recent advances in 3D object detection is made by developing the refinem...
research
03/20/2023

VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking

3D object detectors usually rely on hand-crafted proxies, e.g., anchors ...
research
02/24/2020

3DSSD: Point-based 3D Single Stage Object Detector

Currently, there have been many kinds of voxel-based 3D single stage det...
research
07/16/2020

InfoFocus: 3D Object Detection for Autonomous Driving with Dynamic Information Modeling

Real-time 3D object detection is crucial for autonomous cars. Achieving ...

Please sign up or login with your details

Forgot password? Click here to reset