Design equivariant neural networks for 3D point cloud

05/02/2022
by   Thuan N. A. Trang, et al.
0

This work seeks to improve the generalization and robustness of existing neural networks for 3D point clouds by inducing group equivariance under general group transformations. The main challenge when designing equivariant models for point clouds is how to trade-off the performance of the model and the complexity. Existing equivariant models are either too complicate to implement or very high complexity. The main aim of this study is to build a general procedure to introduce group equivariant property to SOTA models for 3D point clouds. The group equivariant models built form our procedure are simple to implement, less complexity in comparison with the existing ones, and they preserve the strengths of the original SOTA backbone. From the results of the experiments on object classification, it is shown that our methods are superior to other group equivariant models in performance and complexity. Moreover, our method also helps to improve the mIoU of semantic segmentation models. Overall, by using a combination of only-finite-rotation equivariance and augmentation, our models can outperform existing full SO(3)-equivariance models with much cheaper complexity and GPU memory. The proposed procedure is general and forms a fundamental approach to group equivariant neural networks. We believe that it can be easily adapted to other SOTA models in the future.

READ FULL TEXT
research
04/04/2019

Generalizing discrete convolutions for unstructured point clouds

Point clouds are unstructured and unordered data, as opposed to images. ...
research
01/24/2023

Using a Waffle Iron for Automotive Point Cloud Semantic Segmentation

Semantic segmentation of point clouds in autonomous driving datasets req...
research
11/30/2018

Multiview Based 3D Scene Understanding On Partial Point Sets

Deep learning within the context of point clouds has gained much researc...
research
03/10/2023

Combining visibility analysis and deep learning for refinement of semantic 3D building models by conflict classification

Semantic 3D building models are widely available and used in numerous ap...
research
10/06/2020

On the Universality of Rotation Equivariant Point Cloud Networks

Learning functions on point clouds has applications in many fields, incl...
research
09/30/2022

Effective Early Stopping of Point Cloud Neural Networks

Early stopping techniques can be utilized to decrease the time cost, how...
research
04/19/2021

A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groups

Symmetries and equivariance are fundamental to the generalization of neu...

Please sign up or login with your details

Forgot password? Click here to reset