Point Cloud Learning with Transformer

04/28/2021
by   Xian-Feng Han, et al.
0

Remarkable performance from Transformer networks in Natural Language Processing promote the development of these models in dealing with computer vision tasks such as image recognition and segmentation. In this paper, we introduce a novel framework, called Multi-level Multi-scale Point Transformer (MLMSPT) that works directly on the irregular point clouds for representation learning. Specifically, a point pyramid transformer is investigated to model features with diverse resolutions or scales we defined, followed by a multi-level transformer module to aggregate contextual information from different levels of each scale and enhance their interactions. While a multi-scale transformer module is designed to capture the dependencies among representations across different scales. Extensive evaluation on public benchmark datasets demonstrate the effectiveness and the competitive performance of our methods on 3D shape classification, part segmentation and semantic segmentation tasks.

READ FULL TEXT
research
04/27/2021

Dual Transformer for Point Cloud Analysis

Following the tremendous success of transformer in natural language proc...
research
04/06/2023

PointCAT: Cross-Attention Transformer for point cloud

Transformer-based models have significantly advanced natural language pr...
research
04/27/2021

Cross-Level Cross-Scale Cross-Attention Network for Point Cloud Representation

Self-attention mechanism recently achieves impressive advancement in Nat...
research
05/13/2023

Meta-Polyp: a baseline for efficient Polyp segmentation

In recent years, polyp segmentation has gained significant importance, a...
research
11/17/2020

Pyramid Point: A Multi-Level Focusing Network for Revisiting Feature Layers

We present a method to learn a diverse group of object categories from a...
research
07/05/2023

Multi-Scale Prototypical Transformer for Whole Slide Image Classification

Whole slide image (WSI) classification is an essential task in computati...
research
06/14/2023

M^2UNet: MetaFormer Multi-scale Upsampling Network for Polyp Segmentation

Polyp segmentation has recently garnered significant attention, and mult...

Please sign up or login with your details

Forgot password? Click here to reset