AFN: Adaptive Fusion Normalization via Encoder-Decoder Framework

08/07/2023
by   Zikai Zhou, et al.
0

The success of deep learning is inseparable from normalization layers. Researchers have proposed various normalization functions, and each of them has both advantages and disadvantages. In response, efforts have been made to design a unified normalization function that combines all normalization procedures and mitigates their weaknesses. We also proposed a new normalization function called Adaptive Fusion Normalization. Through experiments, we demonstrate AFN outperforms the previous normalization techniques in domain generalization and image classification tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/21/2019

U-Net Training with Instance-Layer Normalization

Normalization layers are essential in a Deep Convolutional Neural Networ...
research
10/09/2017

Does Normalization Methods Play a Role for Hyperspectral Image Classification?

For Hyperspectral image (HSI) datasets, each class have their salient fe...
research
08/05/2023

On problematic practice of using normalization in Self-modeling/Multivariate Curve Resolution (S/MCR)

The paper is briefly dealing with greater or lesser misused normalizatio...
research
11/16/2019

Understanding and Improving Layer Normalization

Layer normalization (LayerNorm) is a technique to normalize the distribu...
research
12/10/2017

Gradient Normalization & Depth Based Decay For Deep Learning

In this paper we introduce a novel method of gradient normalization and ...
research
11/05/2021

Adaptive Warden Strategy for Countering Network Covert Storage Channels

The detection and elimination of covert channels are performed by a netw...
research
10/12/2018

Mode Normalization

Normalization methods are a central building block in the deep learning ...

Please sign up or login with your details

Forgot password? Click here to reset