Semantic Segmentation of Radar Detections using Convolutions on Point Clouds

05/22/2023
by   Marco Braun, et al.
0

For autonomous driving, radar sensors provide superior reliability regardless of weather conditions as well as a significantly high detection range. State-of-the-art algorithms for environment perception based on radar scans build up on deep neural network architectures that can be costly in terms of memory and computation. By processing radar scans as point clouds, however, an increase in efficiency can be achieved in this respect. While Convolutional Neural Networks show superior performance on pattern recognition of regular data formats like images, the concept of convolutions is not yet fully established in the domain of radar detections represented as point clouds. The main challenge in convolving point clouds lies in their irregular and unordered data format and the associated permutation variance. Therefore, we apply a deep-learning based method introduced by PointCNN that weights and permutes grouped radar detections allowing the resulting permutation invariant cluster to be convolved. In addition, we further adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Finally, we show that our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.

READ FULL TEXT
research
12/07/2022

Gaussian Radar Transformer for Semantic Segmentation in Noisy Radar Data

Scene understanding is crucial for autonomous robots in dynamic environm...
research
12/14/2017

Point-wise Convolutional Neural Network

Deep learning with 3D data such as reconstructed point clouds and CAD mo...
research
08/05/2021

3DRIMR: 3D Reconstruction and Imaging via mmWave Radar based on Deep Learning

mmWave radar has been shown as an effective sensing technique in low vis...
research
03/08/2022

Pointillism: Accurate 3D bounding box estimation with multi-radars

Autonomous perception requires high-quality environment sensing in the f...
research
04/14/2021

Deep Evaluation Metric: Learning to Evaluate Simulated Radar Point Clouds for Virtual Testing of Autonomous Driving

The usage of environment sensor models for virtual testing is a promisin...
research
04/13/2023

RadarGNN: Transformation Invariant Graph Neural Network for Radar-based Perception

A reliable perception has to be robust against challenging environmental...
research
04/27/2023

Human Semantic Segmentation using Millimeter-Wave Radar Sparse Point Clouds

This paper presents a framework for semantic segmentation on sparse sequ...

Please sign up or login with your details

Forgot password? Click here to reset