Scale-Rotation-Equivariant Lie Group Convolution Neural Networks (Lie Group-CNNs)

06/12/2023
by   Wei-Dong Qiao, et al.
0

The weight-sharing mechanism of convolutional kernels ensures translation-equivariance of convolution neural networks (CNNs). Recently, rotation-equivariance has been investigated. However, research on scale-equivariance or simultaneous scale-rotation-equivariance is insufficient. This study proposes a Lie group-CNN, which can keep scale-rotation-equivariance for image classification tasks. The Lie group-CNN includes a lifting module, a series of group convolution modules, a global pooling layer, and a classification layer. The lifting module transfers the input image from Euclidean space to Lie group space, and the group convolution is parameterized through a fully connected network using Lie-algebra of Lie-group elements as inputs to achieve scale-rotation-equivariance. The Lie group SIM(2) is utilized to establish the Lie group-CNN with scale-rotation-equivariance. Scale-rotation-equivariance of Lie group-CNN is verified and achieves the best recognition accuracy on the blood cell dataset (97.50 dataset (77.90 convolution, spatial transformer network, and scale-equivariant steerable network. In addition, the generalization ability of the Lie group-CNN on SIM(2) on rotation-equivariance is verified on rotated-MNIST and rotated-CIFAR10, and the robustness of the network is verified on SO(2) and SE(2). Therefore, the Lie group-CNN can successfully extract geometric features and performs equivariant recognition on images with rotation and scale transformations.

READ FULL TEXT

page 5

page 8

page 9

page 10

page 11

research
03/01/2023

Empowering Networks With Scale and Rotation Equivariance Using A Similarity Convolution

The translational equivariant nature of Convolutional Neural Networks (C...
research
02/17/2021

Group Equivariant Conditional Neural Processes

We present the group equivariant conditional neural process (EquivCNP), ...
research
08/21/2022

SIM2E: Benchmarking the Group Equivariant Capability of Correspondence Matching Algorithms

Correspondence matching is a fundamental problem in computer vision and ...
research
11/07/2022

Moving Frame Net: SE(3)-Equivariant Network for Volumes

Equivariance of neural networks to transformations helps to improve thei...
research
09/26/2019

B-Spline CNNs on Lie Groups

Group convolutional neural networks (G-CNNs) can be used to improve clas...
research
10/16/2018

Rotational 3D Texture Classification Using Group Equivariant CNNs

Convolutional Neural Networks (CNNs) traditionally encode translation eq...
research
11/16/2021

Enabling equivariance for arbitrary Lie groups

Although provably robust to translational perturbations, convolutional n...

Please sign up or login with your details

Forgot password? Click here to reset