Improving Robustness of Feature Representations to Image Deformations using Powered Convolution in CNNs

07/25/2017
by   Zhun Sun, et al.
0

In this work, we address the problem of improvement of robustness of feature representations learned using convolutional neural networks (CNNs) to image deformation. We argue that higher moment statistics of feature distributions could be shifted due to image deformations, and the shift leads to degrade of performance and cannot be reduced by ordinary normalization methods as observed in experimental analyses. In order to attenuate this effect, we apply additional non-linearity in CNNs by combining power functions with learnable parameters into convolution operation. In the experiments, we observe that CNNs which employ the proposed method obtain remarkable boost in both the generalization performance and the robustness under various types of deformations using large scale benchmark datasets. For instance, a model equipped with the proposed method obtains 3.3% performance boost in mAP on Pascal Voc object detection task using deformed images, compared to the reference model, while both models provide the same performance using original images. To the best of our knowledge, this is the first work that studies robustness of deep features learned using CNNs to a wide range of deformations for object recognition and detection.

READ FULL TEXT

page 1

page 6

page 8

research
11/30/2015

Design of Kernels in Convolutional Neural Networks for Image Classification

Despite the effectiveness of Convolutional Neural Networks (CNNs) for im...
research
03/16/2020

SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Weights Flipping

The channel redundancy in feature maps of convolutional neural networks ...
research
06/30/2017

Multiple VLAD encoding of CNNs for image classification

Despite the effectiveness of convolutional neural networks (CNNs) especi...
research
07/05/2021

MixStyle Neural Networks for Domain Generalization and Adaptation

Convolutional neural networks (CNNs) often have poor generalization perf...
research
03/22/2023

LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signals

Finding localized correspondences across different images of the same ob...
research
06/19/2019

A simple and effective postprocessing method for image classification

Whether it is computer vision, natural language processing or speech rec...
research
10/20/2021

Combining Different V1 Brain Model Variants to Improve Robustness to Image Corruptions in CNNs

While some convolutional neural networks (CNNs) have surpassed human vis...

Please sign up or login with your details

Forgot password? Click here to reset