DeepAI AI Chat
Log In Sign Up

Cross-Scale Internal Graph Neural Network for Image Super-Resolution

by   Shangchen Zhou, et al.
SenseTime Corporation
Harbin Institute of Technology
Nanyang Technological University

Non-local self-similarity in natural images has been well studied as an effective prior in image restoration. However, for single image super-resolution (SISR), most existing deep non-local methods (e.g., non-local neural networks) only exploit similar patches within the same scale of the low-resolution (LR) input image. Consequently, the restoration is limited to using the same-scale information while neglecting potential high-resolution (HR) cues from other scales. In this paper, we explore the cross-scale patch recurrence property of a natural image, i.e., similar patches tend to recur many times across different scales. This is achieved using a novel cross-scale internal graph neural network (IGNN). Specifically, we dynamically construct a cross-scale graph by searching k-nearest neighboring patches in the downsampled LR image for each query patch in the LR image. We then obtain the corresponding k HR neighboring patches in the LR image and aggregate them adaptively in accordance to the edge label of the constructed graph. In this way, the HR information can be passed from k HR neighboring patches to the LR query patch to help it recover more detailed textures. Besides, these internal image-specific LR/HR exemplars are also significant complements to the external information learned from the training dataset. Extensive experiments demonstrate the effectiveness of IGNN against the state-of-the-art SISR methods including existing non-local networks on standard benchmarks.


page 7

page 8

page 11

page 12


Image Super-Resolution with Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining

Deep convolution-based single image super-resolution (SISR) networks emb...

Image Deblurring and Super-resolution by Adaptive Sparse Domain Selection and Adaptive Regularization

As a powerful statistical image modeling technique, sparse representatio...

Neural Nearest Neighbors Networks

Non-local methods exploiting the self-similarity of natural signals have...

Global Learnable Attention for Single Image Super-Resolution

Self-similarity is valuable to the exploration of non-local textures in ...

Unsupervised Deraining: Where Asymmetric Contrastive Learning Meets Self-similarity

Most of the existing learning-based deraining methods are supervisedly t...

Training Patch Analysis and Mining Skills for Image Restoration Deep Neural Networks

There have been numerous image restoration methods based on deep convolu...