Multi-level Wavelet-CNN for Image Restoration

05/18/2018
by   Pengju Liu, et al.
0

The tradeoff between receptive field size and efficiency is a crucial issue in low level vision. Plain convolutional networks (CNNs) generally enlarge the receptive field at the expense of computational cost. Recently, dilated filtering has been adopted to address this issue. But it suffers from gridding effect, and the resulting receptive field is only a sparse sampling of input image with checkerboard patterns. In this paper, we present a novel multi-level wavelet CNN (MWCNN) model for better tradeoff between receptive field size and computational efficiency. With the modified U-Net architecture, wavelet transform is introduced to reduce the size of feature maps in the contracting subnetwork. Furthermore, another convolutional layer is further used to decrease the channels of feature maps. In the expanding subnetwork, inverse wavelet transform is then deployed to reconstruct the high resolution feature maps. Our MWCNN can also be explained as the generalization of dilated filtering and subsampling, and can be applied to many image restoration tasks. The experimental results clearly show the effectiveness of MWCNN for image denoising, single image super-resolution, and JPEG image artifacts removal.

READ FULL TEXT
research
07/06/2019

Multi-level Wavelet Convolutional Neural Networks

In computer vision, convolutional networks (CNNs) often adopts pooling t...
research
05/16/2023

Content-Adaptive Downsampling in Convolutional Neural Networks

Many convolutional neural networks (CNNs) rely on progressive downsampli...
research
08/06/2018

Detailed Dense Inference with Convolutional Neural Networks via Discrete Wavelet Transform

Dense pixelwise prediction such as semantic segmentation is an up-to-dat...
research
10/01/2021

Reconstructing group wavelet transform from feature maps with a reproducing kernel iteration

In this paper we consider the problem of reconstructing an image that is...
research
08/20/2020

AWNet: Attentive Wavelet Network for Image ISP

As the revolutionary improvement being made on the performance of smartp...
research
09/12/2018

Joint Sub-bands Learning with Clique Structures for Wavelet Domain Super-Resolution

Convolutional neural networks (CNNs) have recently achieved great succes...
research
10/31/2019

Multi-scale Octave Convolutions for Robust Speech Recognition

We propose a multi-scale octave convolution layer to learn robust speech...

Please sign up or login with your details

Forgot password? Click here to reset