PointPillars: Fast Encoders for Object Detection from Point Clouds

12/14/2018
by   Alex H. Lang, et al.
0

Object detection in point clouds is an important aspect of many robotics applications such as autonomous driving. In this paper we consider the problem of encoding a point cloud into a format appropriate for a downstream detection pipeline. Recent literature suggests two types of encoders; fixed encoders tend to be fast but sacrifice accuracy, while encoders that are learned from data are more accurate, but slower. In this work we propose PointPillars, a novel encoder which utilizes PointNets to learn a representation of point clouds organized in vertical columns (pillars). While the encoded features can be used with any standard 2D convolutional detection architecture, we further propose a lean downstream network. Extensive experimentation shows that PointPillars outperforms previous encoders with respect to both speed and accuracy by a large margin. Despite only using lidar, our full detection pipeline significantly outperforms the state of the art, even among fusion methods, with respect to both the 3D and bird's eye view KITTI benchmarks. This detection performance is achieved while running at 62 Hz: a 2 - 4 fold runtime improvement. A faster version of our method matches the state of the art at 105 Hz. These benchmarks suggest that PointPillars is an appropriate encoding for object detection in point clouds.

READ FULL TEXT
research
02/17/2019

PIXOR: Real-time 3D Object Detection from Point Clouds

We address the problem of real-time 3D object detection from point cloud...
research
11/17/2017

VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection

Accurate detection of objects in 3D point clouds is a central problem in...
research
03/12/2022

PillarGrid: Deep Learning-based Cooperative Perception for 3D Object Detection from Onboard-Roadside LiDAR

3D object detection plays a fundamental role in enabling autonomous driv...
research
07/30/2021

From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection

As an emerging data modal with precise distance sensing, LiDAR point clo...
research
06/12/2021

Sparse PointPillars: Exploiting Sparsity in Birds-Eye-View Object Detection

Bird's Eye View (BEV) is a popular representation for processing 3D poin...
research
11/09/2018

RoarNet: A Robust 3D Object Detection based on RegiOn Approximation Refinement

We present RoarNet, a new approach for 3D object detection from a 2D ima...
research
10/12/2021

Improved Pillar with Fine-grained Feature for 3D Object Detection

3D object detection with LiDAR point clouds plays an important role in a...

Please sign up or login with your details

Forgot password? Click here to reset