Deeper or Wider Networks of Point Clouds with Self-attention?

11/29/2020
by   Haoxi Ran, et al.
1

Prevalence of deeper networks driven by self-attention is in stark contrast to underexplored point-based methods. In this paper, we propose groupwise self-attention as the basic block to construct our network: SepNet. Our proposed module can effectively capture both local and global dependencies. This module computes the features of a group based on the summation of the weighted features of any point within the group. For convenience, we generalize groupwise operations to assemble this module. To further facilitate our networks, we deepen and widen SepNet on the tasks of segmentation and classification respectively, and verify its practicality. Specifically, SepNet achieves state-of-the-art for the tasks of classification and segmentation on most of the datasets. We show empirical evidence that SepNet can obtain extra accuracy in classification or segmentation from increased width or depth, respectively.

READ FULL TEXT

page 4

page 7

research
08/27/2021

Learning Inner-Group Relations on Point Clouds

The prevalence of relation networks in computer vision is in stark contr...
research
04/18/2020

DAPnet: A double self-attention convolutional network for segmentation of point clouds

LiDAR point cloud has a complex structure and the 3D semantic labeling o...
research
03/29/2023

Self-positioning Point-based Transformer for Point Cloud Understanding

Transformers have shown superior performance on various computer vision ...
research
10/02/2020

Group Equivariant Stand-Alone Self-Attention For Vision

We provide a general self-attention formulation to impose group equivari...
research
06/22/2020

Limits to Depth Efficiencies of Self-Attention

Self-attention architectures, which are rapidly pushing the frontier in ...
research
08/30/2022

MRL: Learning to Mix with Attention and Convolutions

In this paper, we present a new neural architectural block for the visio...
research
10/09/2020

How Can Self-Attention Networks Recognize Dyck-n Languages?

We focus on the recognition of Dyck-n (𝒟_n) languages with self-attentio...

Please sign up or login with your details

Forgot password? Click here to reset