Image Super-Resolution with Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining

06/02/2020
by   Yiqun Mei, et al.
20

Deep convolution-based single image super-resolution (SISR) networks embrace the benefits of learning from large-scale external image resources for local recovery, yet most existing works have ignored the long-range feature-wise similarities in natural images. Some recent works have successfully leveraged this intrinsic feature correlation by exploring non-local attention modules. However, none of the current deep models have studied another inherent property of images: cross-scale feature correlation. In this paper, we propose the first Cross-Scale Non-Local (CS-NL) attention module with integration into a recurrent neural network. By combining the new CS-NL prior with local and in-scale non-local priors in a powerful recurrent fusion cell, we can find more cross-scale feature correlations within a single low-resolution (LR) image. The performance of SISR is significantly improved by exhaustively integrating all possible priors. Extensive experiments demonstrate the effectiveness of the proposed CS-NL module by setting new state-of-the-arts on multiple SISR benchmarks.

READ FULL TEXT

page 1

page 4

page 7

page 8

research
06/30/2020

Cross-Scale Internal Graph Neural Network for Image Super-Resolution

Non-local self-similarity in natural images has been well studied as an ...
research
06/07/2018

Non-Local Recurrent Network for Image Restoration

Many classic methods have shown non-local self-similarity in natural ima...
research
01/11/2022

Efficient Non-Local Contrastive Attention for Image Super-Resolution

Non-Local Attention (NLA) brings significant improvement for Single Imag...
research
01/15/2020

DeepSUM++: Non-local Deep Neural Network for Super-Resolution of Unregistered Multitemporal Images

Deep learning methods for super-resolution of a remote sensing scene fro...
research
03/04/2022

Adaptive Cross-Layer Attention for Image Restoration

Non-local attention module has been proven to be crucial for image resto...
research
09/07/2021

Kinship Verification Based on Cross-Generation Feature Interaction Learning

Kinship verification from facial images has been recognized as an emergi...
research
05/25/2023

High-Similarity-Pass Attention for Single Image Super-Resolution

Recent developments in the field of non-local attention (NLA) have led t...

Please sign up or login with your details

Forgot password? Click here to reset