Universal Approximation Theorem for Equivariant Maps by Group CNNs

12/27/2020
by   Wataru Kumagai, et al.
0

Group symmetry is inherent in a wide variety of data distributions. Data processing that preserves symmetry is described as an equivariant map and often effective in achieving high performance. Convolutional neural networks (CNNs) have been known as models with equivariance and shown to approximate equivariant maps for some specific groups. However, universal approximation theorems for CNNs have been separately derived with individual techniques according to each group and setting. This paper provides a unified method to obtain universal approximation theorems for equivariant maps by CNNs in various settings. As its significant advantage, we can handle non-linear equivariant maps between infinite-dimensional spaces for non-compact groups.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2021

Implicit Bias of Linear Equivariant Networks

Group equivariant convolutional neural networks (G-CNNs) are generalizat...
research
04/26/2018

Universal approximations of invariant maps by neural networks

We describe generalizations of the universal approximation theorem for n...
research
10/02/2022

Deep Invertible Approximation of Topologically Rich Maps between Manifolds

How can we design neural networks that allow for stable universal approx...
research
11/05/2018

A General Theory of Equivariant CNNs on Homogeneous Spaces

Group equivariant convolutional neural networks (G-CNNs) have recently e...
research
05/30/2022

Universality of group convolutional neural networks based on ridgelet analysis on groups

We investigate the approximation property of group convolutional neural ...
research
10/19/2021

Learning Equivariances and Partial Equivariances from Data

Group equivariant Convolutional Neural Networks (G-CNNs) constrain featu...
research
06/05/2020

Equivariant Maps for Hierarchical Structures

In many real-world settings, we are interested in learning invariant and...

Please sign up or login with your details

Forgot password? Click here to reset