Super Sparse 3D Object Detection

01/05/2023
by   Lue Fan, et al.
0

As the perception range of LiDAR expands, LiDAR-based 3D object detection contributes ever-increasingly to the long-range perception in autonomous driving. Mainstream 3D object detectors often build dense feature maps, where the cost is quadratic to the perception range, making them hardly scale up to the long-range settings. To enable efficient long-range detection, we first propose a fully sparse object detector termed FSD. FSD is built upon the general sparse voxel encoder and a novel sparse instance recognition (SIR) module. SIR groups the points into instances and applies highly-efficient instance-wise feature extraction. The instance-wise grouping sidesteps the issue of the center feature missing, which hinders the design of the fully sparse architecture. To further enjoy the benefit of fully sparse characteristic, we leverage temporal information to remove data redundancy and propose a super sparse detector named FSD++. FSD++ first generates residual points, which indicate the point changes between consecutive frames. The residual points, along with a few previous foreground points, form the super sparse input data, greatly reducing data redundancy and computational overhead. We comprehensively analyze our method on the large-scale Waymo Open Dataset, and state-of-the-art performance is reported. To showcase the superiority of our method in long-range detection, we also conduct experiments on Argoverse 2 Dataset, where the perception range (200m) is much larger than Waymo Open Dataset (75m). Code is open-sourced at https://github.com/tusen-ai/SST.

READ FULL TEXT

page 2

page 9

page 14

research
07/20/2022

Fully Sparse 3D Object Detection

As the perception range of LiDAR increases, LiDAR-based 3D object detect...
research
10/11/2021

UrbanNet: Leveraging Urban Maps for Long Range 3D Object Detection

Relying on monocular image data for precise 3D object detection remains ...
research
08/07/2023

FSD V2: Improving Fully Sparse 3D Object Detection with Virtual Voxels

LiDAR-based fully sparse architecture has garnered increasing attention....
research
12/13/2021

Embracing Single Stride 3D Object Detector with Sparse Transformer

In LiDAR-based 3D object detection for autonomous driving, the ratio of ...
research
01/16/2022

Sparse Cross-scale Attention Network for Efficient LiDAR Panoptic Segmentation

Two major challenges of 3D LiDAR Panoptic Segmentation (PS) are that poi...
research
08/18/2023

Far3D: Expanding the Horizon for Surround-view 3D Object Detection

Recently 3D object detection from surround-view images has made notable ...
research
07/04/2023

SUIT: Learning Significance-guided Information for 3D Temporal Detection

3D object detection from LiDAR point cloud is of critical importance for...

Please sign up or login with your details

Forgot password? Click here to reset