Unsupervised Object Detection with LiDAR Clues

by   Hao Tian, et al.

Despite the importance of unsupervised object detection, to the best of our knowledge, there is no previous work addressing this problem. One main issue, widely known to the community, is that object boundaries derived only from 2D image appearance are ambiguous and unreliable. To address this, we exploit LiDAR clues to aid unsupervised object detection. By exploiting the 3D scene structure, the issue of localization can be considerably mitigated. We further identify another major issue, seldom noticed by the community, that the long-tailed and open-ended (sub-)category distribution should be accommodated. In this paper, we present the first practical method for unsupervised object detection with the aid of LiDAR clues. In our approach, candidate object segments based on 3D point clouds are firstly generated. Then, an iterative segment labeling process is conducted to assign segment labels and to train a segment labeling network, which is based on features from both 2D images and 3D point clouds. The labeling process is carefully designed so as to mitigate the issue of long-tailed and open-ended distribution. The final segment labels are set as pseudo annotations for object detection network training. Extensive experiments on the large-scale Waymo Open dataset suggest that the derived unsupervised object detection method achieves reasonable accuracy compared with that of strong supervision within the LiDAR visible range. Code shall be released.


page 2

page 8

page 14


An LSTM Approach to Temporal 3D Object Detection in LiDAR Point Clouds

Detecting objects in 3D LiDAR data is a core technology for autonomous d...

StarNet: Targeted Computation for Object Detection in Point Clouds

LiDAR sensor systems provide high resolution spatial information about t...

Range Adaptation for 3D Object Detection in LiDAR

LiDAR-based 3D object detection plays a crucial role in modern autonomou...

Embracing Single Stride 3D Object Detector with Sparse Transformer

In LiDAR-based 3D object detection for autonomous driving, the ratio of ...

RoarNet: A Robust 3D Object Detection based on RegiOn Approximation Refinement

We present RoarNet, a new approach for 3D object detection from a 2D ima...

Behind the Curtain: Learning Occluded Shapes for 3D Object Detection

Advances in LiDAR sensors provide rich 3D data that supports 3D scene un...

Roadside Lidar Vehicle Detection and Tracking Using Range And Intensity Background Subtraction

In this paper, we present the solution of roadside LiDAR object detectio...