Attention-based Transformation from Latent Features to Point Clouds

12/10/2021
by   Kaiyi Zhang, et al.
0

In point cloud generation and completion, previous methods for transforming latent features to point clouds are generally based on fully connected layers (FC-based) or folding operations (Folding-based). However, point clouds generated by FC-based methods are usually troubled by outliers and rough surfaces. For folding-based methods, their data flow is large, convergence speed is slow, and they are also hard to handle the generation of non-smooth surfaces. In this work, we propose AXform, an attention-based method to transform latent features to point clouds. AXform first generates points in an interim space, using a fully connected layer. These interim points are then aggregated to generate the target point cloud. AXform takes both parameter sharing and data flow into account, which makes it has fewer outliers, fewer network parameters, and a faster convergence speed. The points generated by AXform do not have the strong 2-manifold constraint, which improves the generation of non-smooth surfaces. When AXform is expanded to multiple branches for local generations, the centripetal constraint makes it has properties of self-clustering and space consistency, which further enables unsupervised semantic segmentation. We also adopt this scheme and design AXformNet for point cloud completion. Considerable experiments on different datasets show that our methods achieve state-of-the-art results.

READ FULL TEXT
research
10/16/2019

Conditional Invertible Flow for Point Cloud Generation

This paper focuses on a novel generative approach for 3D point clouds th...
research
03/18/2022

Completing Partial Point Clouds with Outliers by Collaborative Completion and Segmentation

Most existing point cloud completion methods are only applicable to part...
research
08/10/2021

SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer

Point cloud completion aims to predict a complete shape in high accuracy...
research
02/18/2022

Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer

Most existing point cloud completion methods suffered from discrete natu...
research
07/31/2023

Graph Structure from Point Clouds: Geometric Attention is All You Need

The use of graph neural networks has produced significant advances in po...
research
04/08/2020

Deep Manifold Prior

We present a prior for manifold structured data, such as surfaces of 3D ...
research
05/24/2023

Attention to Mean-Fields for Particle Cloud Generation

The generation of collider data using machine learning has emerged as a ...

Please sign up or login with your details

Forgot password? Click here to reset