Interrelation of equivariant Gaussian processes and convolutional neural networks

09/17/2022
by   Andrey Demichev, et al.
0

Currently there exists rather promising new trend in machine leaning (ML) based on the relationship between neural networks (NN) and Gaussian processes (GP), including many related subtopics, e.g., signal propagation in NNs, theoretical derivation of learning curve for NNs, QFT methods in ML, etc. An important feature of convolutional neural networks (CNN) is their equivariance (consistency) with respect to the symmetry transformations of the input data. In this work we establish a relationship between the many-channel limit for CNNs equivariant with respect to two-dimensional Euclidean group with vector-valued neuron activations and the corresponding independently introduced equivariant Gaussian processes (GP).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2019

Graph Convolutional Gaussian Processes

We propose a novel Bayesian nonparametric method to learn translation-in...
research
06/05/2019

Approximate Inference Turns Deep Networks into Gaussian Processes

Deep neural networks (DNN) and Gaussian processes (GP) are two powerful ...
research
10/12/2019

On the expected behaviour of noise regularised deep neural networks as Gaussian processes

Recent work has established the equivalence between deep neural networks...
research
10/21/2020

Probabilistic Numeric Convolutional Neural Networks

Continuous input signals like images and time series that are irregularl...
research
08/10/2021

The information of attribute uncertainties: what convolutional neural networks can learn about errors in input data

Errors in measurements are key to weighting the value of data, but are o...
research
03/24/2022

Position Tracking using Likelihood Modeling of Channel Features with Gaussian Processes

Recent localization frameworks exploit spatial information of complex ch...
research
10/11/2018

Bayesian Convolutional Neural Networks with Many Channels are Gaussian Processes

There is a previously identified equivalence between wide fully connecte...

Please sign up or login with your details

Forgot password? Click here to reset