DeepPoint: A Deep Learning Model for 3D Reconstruction in Point Clouds via mmWave Radar

09/19/2021
by   Yue Sun, et al.
0

Recent research has shown that mmWave radar sensing is effective for object detection in low visibility environments, which makes it an ideal technique in autonomous navigation systems such as autonomous vehicles. However, due to the characteristics of radar signals such as sparsity, low resolution, specularity, and high noise, it is still quite challenging to reconstruct 3D object shapes via mmWave radar sensing. Built on our recent proposed 3DRIMR (3D Reconstruction and Imaging via mmWave Radar), we introduce in this paper DeepPoint, a deep learning model that generates 3D objects in point cloud format that significantly outperforms the original 3DRIMR design. The model adopts a conditional Generative Adversarial Network (GAN) based deep neural network architecture. It takes as input the 2D depth images of an object generated by 3DRIMR's Stage 1, and outputs smooth and dense 3D point clouds of the object. The model consists of a novel generator network that utilizes a sequence of DeepPoint blocks or layers to extract essential features of the union of multiple rough and sparse input point clouds of an object when observed from various viewpoints, given that those input point clouds may contain many incorrect points due to the imperfect generation process of 3DRIMR's Stage 1. The design of DeepPoint adopts a deep structure to capture the global features of input point clouds, and it relies on an optimally chosen number of DeepPoint blocks and skip connections to achieve performance improvement over the original 3DRIMR design. Our experiments have demonstrated that this model significantly outperforms the original 3DRIMR and other standard techniques in reconstructing 3D objects.

READ FULL TEXT

page 1

page 5

research
07/21/2022

R2P: A Deep Learning Model from mmWave Radar to Point Cloud

Recent research has shown the effectiveness of mmWave radar sensing for ...
research
08/05/2021

3DRIMR: 3D Reconstruction and Imaging via mmWave Radar based on Deep Learning

mmWave radar has been shown as an effective sensing technique in low vis...
research
11/03/2022

3D Reconstruction of Multiple Objects by mmWave Radar on UAV

In this paper, we explore the feasibility of utilizing a mmWave radar se...
research
09/14/2021

Tesla-Rapture: A Lightweight Gesture Recognition System from mmWave Radar Point Clouds

We present Tesla-Rapture, a gesture recognition interface for point clou...
research
08/29/2023

Ego-Motion Estimation and Dynamic Motion Separation from 3D Point Clouds for Accumulating Data and Improving 3D Object Detection

New 3+1D high-resolution radar sensors are gaining importance for 3D obj...
research
02/27/2020

Triangle-Net: Towards Robustness in Point Cloud Classification

3D object recognition is becoming a key desired capability for many comp...
research
03/08/2022

Pointillism: Accurate 3D bounding box estimation with multi-radars

Autonomous perception requires high-quality environment sensing in the f...

Please sign up or login with your details

Forgot password? Click here to reset