Natural and Realistic Single Image Super-Resolution with Explicit Natural Manifold Discrimination

11/09/2019
by   Jae Woong Soh, et al.
13

Recently, many convolutional neural networks for single image super-resolution (SISR) have been proposed, which focus on reconstructing the high-resolution images in terms of objective distortion measures. However, the networks trained with objective loss functions generally fail to reconstruct the realistic fine textures and details that are essential for better perceptual quality. Recovering the realistic details remains a challenging problem, and only a few works have been proposed which aim at increasing the perceptual quality by generating enhanced textures. However, the generated fake details often make undesirable artifacts and the overall image looks somewhat unnatural. Therefore, in this paper, we present a new approach to reconstructing realistic super-resolved images with high perceptual quality, while maintaining the naturalness of the result. In particular, we focus on the domain prior properties of SISR problem. Specifically, we define the naturalness prior in the low-level domain and constrain the output image in the natural manifold, which eventually generates more natural and realistic images. Our results show better naturalness compared to the recent super-resolution algorithms including perception-oriented ones.

READ FULL TEXT

page 1

page 8

research
09/15/2016

Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network

Despite the breakthroughs in accuracy and speed of single image super-re...
research
07/29/2019

Benefiting from Multitask Learning to Improve Single Image Super-Resolution

Despite significant progress toward super resolving more realistic image...
research
11/24/2022

Perception-Oriented Single Image Super-Resolution using Optimal Objective Estimation

Single-image super-resolution (SISR) networks trained with perceptual an...
research
07/20/2018

Photorealistic Video Super Resolution

With the advent of perceptual loss functions, new possibilities in super...
research
08/20/2019

SROBB: Targeted Perceptual Loss for Single Image Super-Resolution

By benefiting from perceptual losses, recent studies have improved signi...
research
05/15/2020

Enhancing Perceptual Loss with Adversarial Feature Matching for Super-Resolution

Single image super-resolution (SISR) is an ill-posed problem with an ind...
research
09/09/2020

Single Image Super-Resolution for Domain-Specific Ultra-Low Bandwidth Image Transmission

Low-bandwidth communication, such as underwater acoustic communication, ...

Please sign up or login with your details

Forgot password? Click here to reset