CompleteDT: Point Cloud Completion with Dense Augment Inference Transformers

05/30/2022
by   Jun Li, et al.
18

Point cloud completion task aims to predict the missing part of incomplete point clouds and generate complete point clouds with details. In this paper, we propose a novel point cloud completion network, CompleteDT, which is based on the transformer. CompleteDT can learn features within neighborhoods and explore the relationship among these neighborhoods. By sampling the incomplete point cloud to obtain point clouds with different resolutions, we extract features from these point clouds in a self-guided manner, while converting these features into a series of patches based on the geometrical structure. To facilitate transformers to leverage sufficient information about point clouds, we provide a plug-and-play module named Relation-Augment Attention Module (RAA), consisting of Point Cross-Attention Module (PCA) and Point Dense Multi-Scale Attention Module (PDMA). These two modules can enhance the ability to learn features within Patches and consider the correlation among these Patches. Thus, RAA enables to learn structures of incomplete point clouds and contribute to infer the local details of complete point clouds generated. In addition, we predict the complete shape from patches with an efficient generation module, namely, Multi-resolution Point Fusion Module (MPF). MPF gradually generates complete point clouds from patches, and updates patches based on these generated point clouds. Experimental results show that our method largely outperforms the state-of-the-art methods.

READ FULL TEXT
research
05/08/2020

Point Cloud Completion by Skip-attention Network with Hierarchical Folding

Point cloud completion aims to infer the complete geometries for missing...
research
08/23/2023

Rotation-Invariant Completion Network

Real-world point clouds usually suffer from incompleteness and display d...
research
03/18/2022

Completing Partial Point Clouds with Outliers by Collaborative Completion and Segmentation

Most existing point cloud completion methods are only applicable to part...
research
12/13/2021

Generate Point Clouds with Multiscale Details from Graph-Represented Structures

Generating point clouds from structures is a highly valued method to con...
research
02/21/2022

PointSCNet: Point Cloud Structure and Correlation Learning Based on Space Filling Curve-Guided Sampling

Geometrical structures and the internal local region relationship, such ...
research
06/26/2019

Spatial Transformer for 3D Points

Point cloud is an efficient representation of 3D visual data, and enable...
research
07/23/2021

3D Brain Reconstruction by Hierarchical Shape-Perception Network from a Single Incomplete Image

3D shape reconstruction is essential in the navigation of minimally-inva...

Please sign up or login with your details

Forgot password? Click here to reset