Point Cloud Recognition with Position-to-Structure Attention Transformers

10/05/2022
by   Zheng Ding, et al.
0

In this paper, we present Position-to-Structure Attention Transformers (PS-Former), a Transformer-based algorithm for 3D point cloud recognition. PS-Former deals with the challenge in 3D point cloud representation where points are not positioned in a fixed grid structure and have limited feature description (only 3D coordinates (x, y, z) for scattered points). Existing Transformer-based architectures in this domain often require a pre-specified feature engineering step to extract point features. Here, we introduce two new aspects in PS-Former: 1) a learnable condensation layer that performs point downsampling and feature extraction; and 2) a Position-to-Structure Attention mechanism that recursively enriches the structural information with the position attention branch. Compared with the competing methods, while being generic with less heuristics feature designs, PS-Former demonstrates competitive experimental results on three 3D point cloud tasks including classification, part segmentation, and scene segmentation.

READ FULL TEXT
research
10/11/2022

Point Transformer V2: Grouped Vector Attention and Partition-based Pooling

As a pioneering work exploring transformer architecture for 3D point clo...
research
04/17/2019

Graph based Dynamic Segmentation of Generic Objects in 3D

We propose a novel 3D segmentation method for RBGD stream data to deal w...
research
04/06/2023

PointCAT: Cross-Attention Transformer for point cloud

Transformer-based models have significantly advanced natural language pr...
research
11/30/2021

CT-block: a novel local and global features extractor for point cloud

Deep learning on the point cloud is increasingly developing. Grouping th...
research
07/22/2020

Cloud Transformers

We present a new versatile building block for deep point cloud processin...
research
03/23/2023

Position-Guided Point Cloud Panoptic Segmentation Transformer

DEtection TRansformer (DETR) started a trend that uses a group of learna...
research
08/04/2022

PointConvFormer: Revenge of the Point-based Convolution

We introduce PointConvFormer, a novel building block for point cloud bas...

Please sign up or login with your details

Forgot password? Click here to reset