Investigating and Explaining the Frequency Bias in Image Classification

05/06/2022
by   Zhiyu Lin, et al.
0

CNNs exhibit many behaviors different from humans, one of which is the capability of employing high-frequency components. This paper discusses the frequency bias phenomenon in image classification tasks: the high-frequency components are actually much less exploited than the low- and mid-frequency components. We first investigate the frequency bias phenomenon by presenting two observations on feature discrimination and learning priority. Furthermore, we hypothesize that (i) the spectral density, (ii) class consistency directly affect the frequency bias. Specifically, our investigations verify that the spectral density of datasets mainly affects the learning priority, while the class consistency mainly affects the feature discrimination.

READ FULL TEXT

page 4

page 5

page 6

research
08/19/2019

Adversarial Defense by Suppressing High-frequency Components

Recent works show that deep neural networks trained on image classificat...
research
05/09/2022

How Does Frequency Bias Affect the Robustness of Neural Image Classifiers against Common Corruption and Adversarial Perturbations?

Model robustness is vital for the reliable deployment of machine learnin...
research
01/23/2022

Wavelet-Attention CNN for Image Classification

The feature learning methods based on convolutional neural network (CNN)...
research
02/27/2022

The Spectral Bias of Polynomial Neural Networks

Polynomial neural networks (PNNs) have been recently shown to be particu...
research
01/14/2023

Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics

Recently, multi-layer perceptrons (MLPs) with ReLU activations have enab...
research
02/16/2023

Frequency-domain Learning for Volumetric-based 3D Data Perception

Frequency-domain learning draws attention due to its superior tradeoff b...
research
04/19/2021

Classification of head impacts based on the spectral density of measurable kinematics

Traumatic brain injury can be caused by head impacts, but many brain inj...

Please sign up or login with your details

Forgot password? Click here to reset