General E(2)-Equivariant Steerable CNNs

11/19/2019
by   Maurice Weiler, et al.
16

The big empirical success of group equivariant networks has led in recent years to the sprouting of a great variety of equivariant network architectures. A particular focus has thereby been on rotation and reflection equivariant CNNs for planar images. Here we give a general description of E(2)-equivariant convolutions in the framework of Steerable CNNs. The theory of Steerable CNNs thereby yields constraints on the convolution kernels which depend on group representations describing the transformation laws of feature spaces. We show that these constraints for arbitrary group representations can be reduced to constraints under irreducible representations. A general solution of the kernel space constraint is given for arbitrary representations of the Euclidean group E(2) and its subgroups. We implement a wide range of previously proposed and entirely new equivariant network architectures and extensively compare their performances. E(2)-steerable convolutions are further shown to yield remarkable gains on CIFAR-10, CIFAR-100 and STL-10 when used as a drop-in replacement for non-equivariant convolutions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/28/2018

Intertwiners between Induced Representations (with Applications to the Theory of Equivariant Neural Networks)

Group equivariant and steerable convolutional neural networks (regular a...
research
12/12/2022

Implicit Neural Convolutional Kernels for Steerable CNNs

Steerable convolutional neural networks (CNNs) provide a general framewo...
research
06/10/2021

Coordinate Independent Convolutional Networks – Isometry and Gauge Equivariant Convolutions on Riemannian Manifolds

Motivated by the vast success of deep convolutional networks, there is a...
research
07/20/2020

PDO-eConvs: Partial Differential Operator Based Equivariant Convolutions

Recent research has shown that incorporating equivariance into neural ne...
research
11/05/2018

A General Theory of Equivariant CNNs on Homogeneous Spaces

Group equivariant convolutional neural networks (G-CNNs) have recently e...
research
07/25/2023

Exploring the Sharpened Cosine Similarity

Convolutional layers have long served as the primary workhorse for image...
research
03/30/2020

Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets

We introduce blueprint separable convolutions (BSConv) as highly efficie...

Please sign up or login with your details

Forgot password? Click here to reset