Towards Learning Affine-Invariant Representations via Data-Efficient CNNs

08/31/2019
by   Xenju Xu, et al.
0

In this paper we propose integrating a priori knowledge into both design and training of convolutional neural networks (CNNs) to learn object representations that are invariant to affine transformations (i.e., translation, scale, rotation). Accordingly we propose a novel multi-scale maxout CNN and train it end-to-end with a novel rotation-invariant regularizer. This regularizer aims to enforce the weights in each 2D spatial filter to approximate circular patterns. In this way, we manage to handle affine transformations in training using convolution, multi-scale maxout, and circular filters. Empirically we demonstrate that such knowledge can significantly improve the data-efficiency as well as generalization and robustness of learned models. For instance, on the Traffic Sign data set and trained with only 10 images per class, our method can achieve 84.15 state-of-the-art by 29.80

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/15/2018

Studying Invariances of Trained Convolutional Neural Networks

Convolutional Neural Networks (CNNs) define an exceptionally powerful cl...
research
06/10/2019

Scale Steerable Filters for Locally Scale-Invariant Convolutional Neural Networks

Augmenting transformation knowledge onto a convolutional neural network'...
research
03/24/2020

A Simple Fix for Convolutional Neural Network via Coordinate Embedding

Convolutional Neural Networks (CNN) has been widely applied in the realm...
research
02/04/2015

Learning Local Invariant Mahalanobis Distances

For many tasks and data types, there are natural transformations to whic...
research
03/05/2019

Learning a smooth kernel regularizer for convolutional neural networks

Modern deep neural networks require a tremendous amount of data to train...
research
09/01/2023

Affine-Transformation-Invariant Image Classification by Differentiable Arithmetic Distribution Module

Although Convolutional Neural Networks (CNNs) have achieved promising re...
research
09/06/2017

Polar Transformer Networks

Convolutional neural networks (CNNs) are inherently equivariant to trans...

Please sign up or login with your details

Forgot password? Click here to reset