Dual Reconstruction Nets for Image Super-Resolution with Gradient Sensitive Loss

09/19/2018
by   Yong Guo, et al.
10

Deep neural networks have exhibited promising performance in image super-resolution (SR) due to the power in learning the non-linear mapping from low-resolution (LR) images to high-resolution (HR) images. However, most deep learning methods employ feed-forward architectures, and thus the dependencies between LR and HR images are not fully exploited, leading to limited learning performance. Moreover, most deep learning based SR methods apply the pixel-wise reconstruction error as the loss, which, however, may fail to capture high-frequency information and produce perceptually unsatisfying results, whilst the recent perceptual loss relies on some pre-trained deep model and they may not generalize well. In this paper, we introduce a mask to separate the image into low- and high-frequency parts based on image gradient magnitude, and then devise a gradient sensitive loss to well capture the structures in the image without sacrificing the recovery of low-frequency content. Moreover, by investigating the duality in SR, we develop a dual reconstruction network (DRN) to improve the SR performance. We provide theoretical analysis on the generalization performance of our method and demonstrate its effectiveness and superiority with thorough experiments.

READ FULL TEXT

page 6

page 8

page 14

page 16

research
01/20/2017

Dual Recovery Network with Online Compensation for Image Super-Resolution

The image super-resolution (SR) methods will essentially lead to a loss ...
research
12/08/2022

A Scale-Arbitrary Image Super-Resolution Network Using Frequency-domain Information

Image super-resolution (SR) is a technique to recover lost high-frequenc...
research
07/31/2022

Robust Real-World Image Super-Resolution against Adversarial Attacks

Recently deep neural networks (DNNs) have achieved significant success i...
research
07/16/2022

Towards Lightweight Super-Resolution with Dual Regression Learning

Deep neural networks have exhibited remarkable performance in image supe...
research
11/19/2018

Learning to synthesize: splitting and recombining low and high spatial frequencies for image recovery

Deep Neural Network (DNN)-based image reconstruction, despite many succe...
research
08/11/2021

Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescaling

Normalizing flows have recently demonstrated promising results for low-l...
research
04/11/2019

Difficulty-aware Image Super Resolution via Deep Adaptive Dual-Network

Recently, deep learning based single image super-resolution(SR) approach...

Please sign up or login with your details

Forgot password? Click here to reset