Rotation-Invariant Point Convolution With Multiple Equivariant Alignments

12/07/2020
by   Hugues Thomas, et al.
0

Recent attempts at introducing rotation invariance or equivariance in 3D deep learning approaches have shown promising results, but these methods still struggle to reach the performances of standard 3D neural networks. In this work we study the relation between equivariance and invariance in 3D point convolutions. We show that using rotation-equivariant alignments, it is possible to make any convolutional layer rotation-invariant. Furthermore, we improve this simple alignment procedure by using the alignment themselves as features in the convolution, and by combining multiple alignments together. With this core layer, we design rotation-invariant architectures which improve state-of-the-art results in both object classification and semantic segmentation and reduces the gap between rotation-invariant and standard 3D deep learning approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2019

Rotation Invariant Convolutions for 3D Point Clouds Deep Learning

Recent progresses in 3D deep learning has shown that it is possible to d...
research
10/02/2020

Rotated Ring, Radial and Depth Wise Separable Radial Convolutions

Simple image rotations significantly reduce the accuracy of deep neural ...
research
09/14/2016

Warped Convolutions: Efficient Invariance to Spatial Transformations

Convolutional Neural Networks (CNNs) are extremely efficient, since they...
research
05/22/2021

Principled Design of Translation, Scale, and Rotation Invariant Variation Operators for Metaheuristics

In the past three decades, a large number of metaheuristics have been pr...
research
06/28/2016

Theta-RBM: Unfactored Gated Restricted Boltzmann Machine for Rotation-Invariant Representations

Learning invariant representations is a critical task in computer vision...
research
08/31/2021

Designing Rotationally Invariant Neural Networks from PDEs and Variational Methods

Partial differential equation (PDE) models and their associated variatio...
research
12/17/2019

Quaternion Product Units for Deep Learning on 3D Rotation Groups

We propose a novel quaternion product unit (QPU) to represent data on 3D...

Please sign up or login with your details

Forgot password? Click here to reset