VC dimensions of group convolutional neural networks

We study the generalization capacity of group convolutional neural networks. We identify precise estimates for the VC dimensions of simple sets of group convolutional neural networks. In particular, we find that for infinite groups and appropriately chosen convolutional kernels, already two-parameter families of convolutional neural networks have an infinite VC dimension, despite being invariant to the action of an infinite group.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/23/2014

One weird trick for parallelizing convolutional neural networks

I present a new way to parallelize the training of convolutional neural ...
research
10/17/2022

A tradeoff between universality of equivariant models and learnability of symmetries

We prove an impossibility result, which in the context of function learn...
research
02/11/2018

On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups

Convolutional neural networks have been extremely successful in the imag...
research
04/22/2022

A Note on the Regularity of Images Generated by Convolutional Neural Networks

The regularity of images generated by convolutional neural networks, suc...
research
11/05/2020

Identifying and interpreting tuning dimensions in deep networks

In neuroscience, a tuning dimension is a stimulus attribute that account...
research
10/22/2020

Learning Invariances in Neural Networks

Invariances to translations have imbued convolutional neural networks wi...

Please sign up or login with your details

Forgot password? Click here to reset