Dual Transformer for Point Cloud Analysis

04/27/2021
by   Xian-Feng Han, et al.
0

Following the tremendous success of transformer in natural language processing and image understanding tasks, in this paper, we present a novel point cloud representation learning architecture, named Dual Transformer Network (DTNet), which mainly consists of Dual Point Cloud Transformer (DPCT) module. Specifically, by aggregating the well-designed point-wise and channel-wise multi-head self-attention models simultaneously, DPCT module can capture much richer contextual dependencies semantically from the perspective of position and channel. With the DPCT module as a fundamental component, we construct the DTNet for performing point cloud analysis in an end-to-end manner. Extensive quantitative and qualitative experiments on publicly available benchmarks demonstrate the effectiveness of our proposed transformer framework for the tasks of 3D point cloud classification and segmentation, achieving highly competitive performance in comparison with the state-of-the-art approaches.

READ FULL TEXT
research
09/21/2022

3DPCT: 3D Point Cloud Transformer with Dual Self-attention

Transformers have resulted in remarkable achievements in the field of im...
research
04/27/2021

Cross-Level Cross-Scale Cross-Attention Network for Point Cloud Representation

Self-attention mechanism recently achieves impressive advancement in Nat...
research
04/28/2021

Point Cloud Learning with Transformer

Remarkable performance from Transformer networks in Natural Language Pro...
research
04/06/2023

PointCAT: Cross-Attention Transformer for point cloud

Transformer-based models have significantly advanced natural language pr...
research
02/13/2022

LighTN: Light-weight Transformer Network for Performance-overhead Tradeoff in Point Cloud Downsampling

Compared with traditional task-irrelevant downsampling methods, task-ori...
research
12/05/2021

Adaptive Channel Encoding Transformer for Point Cloud Analysis

Transformer plays an increasingly important role in various computer vis...
research
02/09/2021

Point Cloud Transformers applied to Collider Physics

Methods for processing point cloud information have seen a great success...

Please sign up or login with your details

Forgot password? Click here to reset