LocalNorm: Robust Image Classification through Dynamically Regularized Normalization

02/18/2019
by   Bojian Yin, et al.
16

While modern convolutional neural networks achieve outstanding accuracy on many image classification tasks, they are, compared to humans, much more sensitive to image degradation. Here, we describe a variant of Batch Normalization, LocalNorm, that regularizes the normalization layer in the spirit of Dropout while dynamically adapting to the local image intensity and contrast at test-time. We show that the resulting deep neural networks are much more resistant to noise-induced image degradation, improving accuracy by up to three times, while achieving the same or slightly better accuracy on non-degraded classical benchmarks. In computational terms, LocalNorm adds negligible training cost and little or no cost at inference time, and can be applied to already-trained networks in a straightforward manner.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 9

page 10

page 11

research
03/03/2019

Accelerating Training of Deep Neural Networks with a Standardization Loss

A significant advance in accelerating neural network training has been t...
research
09/14/2021

A trainable monogenic ConvNet layer robust in front of large contrast changes in image classification

Convolutional Neural Networks (ConvNets) at present achieve remarkable p...
research
10/05/2021

Distribution Mismatch Correction for Improved Robustness in Deep Neural Networks

Deep neural networks rely heavily on normalization methods to improve th...
research
07/16/2019

Single-bit-per-weight deep convolutional neural networks without batch-normalization layers for embedded systems

Batch-normalization (BN) layers are thought to be an integrally importan...
research
03/24/2021

W2WNet: a two-module probabilistic Convolutional Neural Network with embedded data cleansing functionality

Convolutional Neural Networks (CNNs) are supposed to be fed with only hi...
research
09/27/2018

Smooth Inter-layer Propagation of Stabilized Neural Networks for Classification

Recent work has studied the reasons for the remarkable performance of de...
research
09/24/2017

Comparison of Batch Normalization and Weight Normalization Algorithms for the Large-scale Image Classification

Batch normalization (BN) has become a de facto standard for training dee...

Please sign up or login with your details

Forgot password? Click here to reset