Point Transformer

11/02/2020
by   Nico Engel, et al.
79

In this work, we present Point Transformer, a deep neural network that operates directly on unordered and unstructured point sets. We design Point Transformer to extract local and global features and relate both representations by introducing the local-global attention mechanism, which aims to capture spatial point relations and shape information. For that purpose, we propose SortNet, as part of the Point Transformer, which induces input permutation invariance by selecting points based on a learned score. The output of Point Transformer is a sorted and permutation invariant feature list that can directly be incorporated into common computer vision applications. We evaluate our approach on standard classification and part segmentation benchmarks to demonstrate competitive results compared to the prior work.

READ FULL TEXT
research
05/24/2023

GTNet: Graph Transformer Network for 3D Point Cloud Classification and Semantic Segmentation

Recently, graph-based and Transformer-based deep learning networks have ...
research
03/08/2022

DuMLP-Pin: A Dual-MLP-dot-product Permutation-invariant Network for Set Feature Extraction

Existing permutation-invariant methods can be divided into two categorie...
research
04/08/2022

Points to Patches: Enabling the Use of Self-Attention for 3D Shape Recognition

While the Transformer architecture has become ubiquitous in the machine ...
research
05/04/2023

Point Transformer For Coronary Artery Labeling

Coronary CT angiography (CCTA) scans are widely used for diagnosis of co...
research
04/27/2023

Exploiting Inductive Bias in Transformer for Point Cloud Classification and Segmentation

Discovering inter-point connection for efficient high-dimensional featur...
research
03/08/2023

Full Point Encoding for Local Feature Aggregation in 3D Point Clouds

Point cloud processing methods exploit local point features and global c...
research
07/04/2019

Attentive Context Normalization for Robust Permutation-Equivariant Learning

Many problems in computer vision require dealing with sparse, unstructur...

Please sign up or login with your details

Forgot password? Click here to reset