Deep Rotation Equivariant Network

05/24/2017
by   Junying Li, et al.
0

Recently, learning equivariant representations has attracted considerable research attention. Dieleman et al. introduce four operations which can be inserted to CNN to learn deep representations equivariant to rotation. However, feature maps should be copied and rotated four times in each layer in their approach, which causes much running time and memory overhead. In order to address this problem, we propose Deep Rotation Equivariant Network(DREN) consisting of cycle layers, isotonic layers and decycle layers.Our proposed layers apply rotation transformation on filters rather than feature maps, achieving a speed up of more than 2 times with even less memory overhead. We evaluate DRENs on Rotated MNIST and CIFAR-10 datasets and demonstrate that it can improve the performance of state-of-the-art architectures. Our codes are released on GitHub.

READ FULL TEXT

page 7

page 9

research
04/30/2020

Inability of spatial transformations of CNN feature maps to support invariant recognition

A large number of deep learning architectures use spatial transformation...
research
05/27/2019

SpecNet: Spectral Domain Convolutional Neural Network

The memory consumption of most Convolutional Neural Network (CNN) archit...
research
03/23/2019

Rotated Feature Network for multi-orientation object detection

General detectors follow the pipeline that feature maps extracted from C...
research
05/28/2016

Aspect Level Sentiment Classification with Deep Memory Network

We introduce a deep memory network for aspect level sentiment classifica...
research
12/06/2017

Top-down Flow Transformer Networks

We study the deformation fields of feature maps across convolutional net...
research
04/17/2021

Towards Efficient Convolutional Network Models with Filter Distribution Templates

Increasing number of filters in deeper layers when feature maps are decr...
research
03/05/2023

Estimating Extreme 3D Image Rotation with Transformer Cross-Attention

The estimation of large and extreme image rotation plays a key role in m...

Please sign up or login with your details

Forgot password? Click here to reset