Pointillism: Accurate 3D bounding box estimation with multi-radars

03/08/2022
by   Kshitiz Bansal, et al.
0

Autonomous perception requires high-quality environment sensing in the form of 3D bounding boxes of dynamic objects. The primary sensors used in automotive systems are light-based cameras and LiDARs. However, they are known to fail in adverse weather conditions. Radars can potentially solve this problem as they are barely affected by adverse weather conditions. However, specular reflections of wireless signals cause poor performance of radar point clouds. We introduce Pointillism, a system that combines data from multiple spatially separated radars with an optimal separation to mitigate these problems. We introduce a novel concept of Cross Potential Point Clouds, which uses the spatial diversity induced by multiple radars and solves the problem of noise and sparsity in radar point clouds. Furthermore, we present the design of RP-net, a novel deep learning architecture, designed explicitly for radar's sparse data distribution, to enable accurate 3D bounding box estimation. The spatial techniques designed and proposed in this paper are fundamental to radars point cloud distribution and would benefit other radar sensing applications.

READ FULL TEXT

page 7

page 8

page 9

research
09/15/2022

4DenoiseNet: Adverse Weather Denoising from Adjacent Point Clouds

Reliable point cloud data is essential for perception tasks e.g. in robo...
research
08/29/2023

Ego-Motion Estimation and Dynamic Motion Separation from 3D Point Clouds for Accumulating Data and Improving 3D Object Detection

New 3+1D high-resolution radar sensors are gaining importance for 3D obj...
research
05/22/2023

Semantic Segmentation of Radar Detections using Convolutions on Point Clouds

For autonomous driving, radar sensors provide superior reliability regar...
research
04/03/2023

3D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Clouds

Robust point cloud parsing under all-weather conditions is crucial to le...
research
11/11/2022

RaLiBEV: Radar and LiDAR BEV Fusion Learning for Anchor Box Free Object Detection System

Radar, the only sensor that could provide reliable perception capability...
research
09/19/2021

DeepPoint: A Deep Learning Model for 3D Reconstruction in Point Clouds via mmWave Radar

Recent research has shown that mmWave radar sensing is effective for obj...
research
03/06/2023

Histogram-based Deep Learning for Automotive Radar

There are various automotive applications that rely on correctly interpr...

Please sign up or login with your details

Forgot password? Click here to reset