Invariant Integration in Deep Convolutional Feature Space

04/20/2020
by   Matthias Rath, et al.
0

In this contribution, we show how to incorporate prior knowledge to a deep neural network architecture in a principled manner. We enforce feature space invariances using a novel layer based on invariant integration. This allows us to construct a complete feature space invariant to finite transformation groups. We apply our proposed layer to explicitly insert invariance properties for vision-related classification tasks, demonstrate our approach for the case of rotation invariance and report state-of-the-art performance on the Rotated-MNIST dataset. Our method is especially beneficial when training with limited data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2022

Improving the Sample-Complexity of Deep Classification Networks with Invariant Integration

Leveraging prior knowledge on intraclass variance due to transformations...
research
08/02/2019

Recognizing Image Objects by Relational Analysis Using Heterogeneous Superpixels and Deep Convolutional Features

Superpixel-based methodologies have become increasingly popular in compu...
research
06/12/2020

Traversal-invariant characterizations of logarithmic space

We give a novel descriptive-complexity theoretic characterization of L a...
research
03/02/2023

Deep Neural Networks with Efficient Guaranteed Invariances

We address the problem of improving the performance and in particular th...
research
06/11/2014

"Mental Rotation" by Optimizing Transforming Distance

The human visual system is able to recognize objects despite transformat...
research
04/23/2022

Transformation Invariant Cancerous Tissue Classification Using Spatially Transformed DenseNet

In this work, we introduce a spatially transformed DenseNet architecture...
research
05/22/2021

Principled Design of Translation, Scale, and Rotation Invariant Variation Operators for Metaheuristics

In the past three decades, a large number of metaheuristics have been pr...

Please sign up or login with your details

Forgot password? Click here to reset