Self-supervised Point Cloud Completion on Real Traffic Scenes via Scene-concerned Bottom-up Mechanism

03/20/2022
by   Yiming Ren, et al.
0

Real scans always miss partial geometries of objects due to the self-occlusions, external-occlusions, and limited sensor resolutions. Point cloud completion aims to refer the complete shapes for incomplete 3D scans of objects. Current deep learning-based approaches rely on large-scale complete shapes in the training process, which are usually obtained from synthetic datasets. It is not applicable for real-world scans due to the domain gap. In this paper, we propose a self-supervised point cloud completion method (TraPCC) for vehicles in real traffic scenes without any complete data. Based on the symmetry and similarity of vehicles, we make use of consecutive point cloud frames to construct vehicle memory bank as reference. We design a bottom-up mechanism to focus on both local geometry details and global shape features of inputs. In addition, we design a scene-graph in the network to pay attention to the missing parts by the aid of neighboring vehicles. Experiments show that TraPCC achieve good performance for real-scan completion on KITTI and nuScenes traffic datasets even without any complete data in training. We also show a downstream application of 3D detection, which benefits from our completion approach.

READ FULL TEXT
research
05/28/2023

Point-PC: Point Cloud Completion Guided by Prior Knowledge via Causal Inference

Point cloud completion aims to recover raw point clouds captured by scan...
research
11/21/2021

Self-Supervised Point Cloud Completion via Inpainting

When navigating in urban environments, many of the objects that need to ...
research
11/29/2019

SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans

We present a novel approach that converts partial and noisy RGB-D scans ...
research
01/05/2022

Towards realistic symmetry-based completion of previously unseen point clouds

3D scanning is a complex multistage process that generates a point cloud...
research
10/17/2020

A Self-supervised Cascaded Refinement Network for Point Cloud Completion

Point clouds are often sparse and incomplete, which imposes difficulties...
research
03/14/2021

Cycle4Completion: Unpaired Point Cloud Completion using Cycle Transformation with Missing Region Coding

In this paper, we present a novel unpaired point cloud completion networ...
research
03/20/2022

Towards 3D Scene Understanding by Referring Synthetic Models

Promising performance has been achieved for visual perception on the poi...

Please sign up or login with your details

Forgot password? Click here to reset