Equivariant Point Cloud Analysis via Learning Orientations for Message Passing

03/28/2022
by   Shitong Luo, et al.
8

Equivariance has been a long-standing concern in various fields ranging from computer vision to physical modeling. Most previous methods struggle with generality, simplicity, and expressiveness – some are designed ad hoc for specific data types, some are too complex to be accessible, and some sacrifice flexible transformations. In this work, we propose a novel and simple framework to achieve equivariance for point cloud analysis based on the message passing (graph neural network) scheme. We find the equivariant property could be obtained by introducing an orientation for each point to decouple the relative position for each point from the global pose of the entire point cloud. Therefore, we extend current message passing networks with a module that learns orientations for each point. Before aggregating information from the neighbors of a point, the networks transforms the neighbors' coordinates based on the point's learned orientations. We provide formal proofs to show the equivariance of the proposed framework. Empirically, we demonstrate that our proposed method is competitive on both point cloud analysis and physical modeling tasks. Code is available at https://github.com/luost26/Equivariant-OrientedMP .

READ FULL TEXT
research
07/13/2022

PointNorm: Normalization is All You Need for Point Cloud Analysis

Point cloud analysis is challenging due to the irregularity of the point...
research
10/27/2022

Point-Voxel Adaptive Feature Abstraction for Robust Point Cloud Classification

Great progress has been made in point cloud classification with learning...
research
12/05/2022

PointCaM: Cut-and-Mix for Open-Set Point Cloud Analysis

Point cloud analysis is receiving increasing attention, however, most ex...
research
04/03/2020

LiDAR-based Online 3D Video Object Detection with Graph-based Message Passing and Spatiotemporal Transformer Attention

Existing LiDAR-based 3D object detectors usually focus on the single-fra...
research
10/12/2021

Continuous Conditional Random Field Convolution for Point Cloud Segmentation

Point cloud segmentation is the foundation of 3D environmental perceptio...
research
08/22/2022

Equivariant Hypergraph Neural Networks

Many problems in computer vision and machine learning can be cast as lea...
research
01/27/2020

Deep Graph Matching Consensus

This work presents a two-stage neural architecture for learning and refi...

Please sign up or login with your details

Forgot password? Click here to reset