WaveCNet: Wavelet Integrated CNNs to Suppress Aliasing Effect for Noise-Robust Image Classification

by   Qiufu Li, et al.

Though widely used in image classification, convolutional neural networks (CNNs) are prone to noise interruptions, i.e. the CNN output can be drastically changed by small image noise. To improve the noise robustness, we try to integrate CNNs with wavelet by replacing the common down-sampling (max-pooling, strided-convolution, and average pooling) with discrete wavelet transform (DWT). We firstly propose general DWT and inverse DWT (IDWT) layers applicable to various orthogonal and biorthogonal discrete wavelets like Haar, Daubechies, and Cohen, etc., and then design wavelet integrated CNNs (WaveCNets) by integrating DWT into the commonly used CNNs (VGG, ResNets, and DenseNet). During the down-sampling, WaveCNets apply DWT to decompose the feature maps into the low-frequency and high-frequency components. Containing the main information including the basic object structures, the low-frequency component is transmitted into the following layers to generate robust high-level features. The high-frequency components are dropped to remove most of the data noises. The experimental results show that training, and WaveCNets achieve higher accuracy on ImageNet than various vanilla CNNs. We have also tested the performance of WaveCNets on the noisy version of ImageNet, ImageNet-C and six adversarial attacks, the results suggest that the proposed DWT/IDWT layers could provide better noise-robustness and adversarial robustness. When applying WaveCNets as backbones, the performance of object detectors (i.e., faster R-CNN and RetinaNet) on COCO detection dataset are consistently improved. We believe that suppression of aliasing effect, i.e. separation of low frequency and high frequency information, is the main advantages of our approach. The code of our DWT/IDWT layer and different WaveCNets are available at https://github.com/CVI-SZU/WaveCNet.


page 1

page 8

page 10

page 14

page 15


Wavelet Integrated CNNs for Noise-Robust Image Classification

Convolutional Neural Networks (CNNs) are generally prone to noise interr...

Preservation of High Frequency Content for Deep Learning-Based Medical Image Classification

Chest radiographs are used for the diagnosis of multiple critical illnes...

Wavelet-Attention CNN for Image Classification

The feature learning methods based on convolutional neural network (CNN)...

WaveSNet: Wavelet Integrated Deep Networks for Image Segmentation

In deep networks, the lost data details significantly degrade the perfor...

Exploring Novel Pooling Strategies for Edge Preserved Feature Maps in Convolutional Neural Networks

With the introduction of anti-aliased convolutional neural networks (CNN...

Orthogonal Convolutional Neural Networks

The instability and feature redundancy in CNNs hinders further performan...

Deep Convolutional Neural Network to Detect J-UNIWARD

This paper presents an empirical study on applying convolutional neural ...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset