Group Equivariant Conditional Neural Processes

02/17/2021
by   Makoto Kawano, et al.
0

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in data space. Incorporating group equivariance, such as rotation and scaling equivariance, provides a way to consider the symmetry of real-world data. We give a decomposition theorem for permutation-invariant and group-equivariant maps, which leads us to construct EquivCNPs with an infinite-dimensional latent space to handle group symmetries. In this paper, we build architecture using Lie group convolutional layers for practical implementation. We show that EquivCNP with translation equivariance achieves comparable performance to conventional CNPs in a 1D regression task. Moreover, we demonstrate that incorporating an appropriate Lie group equivariance, EquivCNP is capable of zero-shot generalization for an image-completion task by selecting an appropriate Lie group equivariance.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 9

page 10

page 13

research
06/12/2023

Scale-Rotation-Equivariant Lie Group Convolution Neural Networks (Lie Group-CNNs)

The weight-sharing mechanism of convolutional kernels ensures translatio...
research
02/25/2020

Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Data

The translation equivariance of convolutional layers enables convolution...
research
09/19/2020

Learning a Lie Algebra from Unlabeled Data Pairs

Deep convolutional networks (convnets) show a remarkable ability to lear...
research
07/04/2023

Learning Lie Group Symmetry Transformations with Neural Networks

The problem of detecting and quantifying the presence of symmetries in d...
research
06/08/2022

Parametric Lie group structures on the probabilistic simplex and generalized Compositional Data

In this paper we build a set of parametric quotient Lie group structures...
research
10/29/2019

Convolutional Conditional Neural Processes

We introduce the Convolutional Conditional Neural Process (ConvCNP), a n...
research
12/14/2016

Permutation-equivariant neural networks applied to dynamics prediction

The introduction of convolutional layers greatly advanced the performanc...

Please sign up or login with your details

Forgot password? Click here to reset